Is there a way to delete a bigquery table only after all the steps in a batch dataflow pipeline have succeeded?
有没有办法在批量数据流管道中的所有步骤都成功后删除bigquery表？
1 个解决方案
#1
4
You can use DataflowPipelineJob.waitToFinish(...) to wait for your job to finish, check that the returned state was DONE, and then use the BigQuery API to delete the table.
您可以使用DataflowPipelineJob.waitToFinish（...）等待您的作业完成，检查返回的状态是否已完成，然后使用BigQuery API删除该表。
#1
4
You can use DataflowPipelineJob.waitToFinish(...) to wait for your job to finish, check that the returned state was DONE, and then use the BigQuery API to delete the table.
您可以使用DataflowPipelineJob.waitToFinish（...）等待您的作业完成，检查返回的状态是否已完成，然后使用BigQuery API删除该表。