Is there any way to know whether BigQueryIO.write() operation has successfully completed within the program? It returns WriteResult but couldn't find any relevant methods in it. Or is there?
有没有办法知道BigQueryIO.write（）操作是否已在程序中成功完成？它返回WriteResult但无法在其中找到任何相关方法。或者有吗？
1 个解决方案
#1
1
If any operation in a pipeline fails, it is retried. If it fails repeatedly, a Batch job is terminated and marked as failed and a Streaming job continues retrying forever. The WriteResult allows you to use the InsertRetryPolicy to control how errors are retried. This allows the IO to partially succeed and indicate which rows had problems. If you don't set the InsertRetryPolicy, then a completed pipeline means that the write has successfully completed.
如果管道中的任何操作失败，则重试该操作。如果重复失败，则终止批处理作业并将其标记为失败，并且流式处理作业将继续永久重试。 WriteResult允许您使用InsertRetryPolicy来控制重试错误的方式。这允许IO部分成功并指示哪些行有问题。如果未设置InsertRetryPolicy，则完成的管道意味着写入已成功完成。
If this doesn't address your concerns, could you elaborate on what you are trying to do?
如果这不能解决您的疑虑，您能否详细说明您要做的事情？
#1
1
If any operation in a pipeline fails, it is retried. If it fails repeatedly, a Batch job is terminated and marked as failed and a Streaming job continues retrying forever. The WriteResult allows you to use the InsertRetryPolicy to control how errors are retried. This allows the IO to partially succeed and indicate which rows had problems. If you don't set the InsertRetryPolicy, then a completed pipeline means that the write has successfully completed.
如果管道中的任何操作失败，则重试该操作。如果重复失败，则终止批处理作业并将其标记为失败，并且流式处理作业将继续永久重试。 WriteResult允许您使用InsertRetryPolicy来控制重试错误的方式。这允许IO部分成功并指示哪些行有问题。如果未设置InsertRetryPolicy，则完成的管道意味着写入已成功完成。
If this doesn't address your concerns, could you elaborate on what you are trying to do?
如果这不能解决您的疑虑，您能否详细说明您要做的事情？