写入Big Query时数据流作业失败 - 找不到JSON文件

时间:2022-04-03 15:25:45

We've recently had a Dataflow job fail because it could not find the json file to load into Big Query. My understanding is that the json file is generated by Dataflow and that this is an unexpected state.

我们最近有一个Dataflow作业失败,因为它找不到要加载到Big Query的json文件。我的理解是,json文件是由Dataflow生成的,这是一个意外的状态。

The job has been running daily for almost a year and this is the first time we've seen this error. A subsequent run was also successful.

这项工作每天都在运行近一年,这是我们第一次看到这个错误。随后的运行也取得了成功。

Oct 26, 2015, 3:13:32 PM S15: (1c654a773802760a): Workflow failed. Causes: (1c654a773802735f): BigQuery import job "dataflow_job_11909924374132686736" failed. Causes: (1c654a77380270b4): BigQuery job "dataflow_job_11909924374132686736" in project "project_name" finished with error(s): job error: Not found: Google Storage File gs://cdf/binaries/denormailization/11909924374132684847/-00081-of-00120.json, error: Not found: Google Storage File gs://cdf/binaries/denormailization/11909924374132684847/-00081-of-00120.json

2015年10月26日,下午3:13:32 S15:(1c654a773802760a):工作流程失败。原因:(1c654a773802735f):BigQuery导入作业“dataflow_job_11909924374132686736”失败。原因:(1c654a77380270b4):项目“project_name”中的BigQuery作业“dataflow_job_11909924374132686736”已完成错误:作业错误:未找到:Google存储文件gs:// cdf / binaries / denormailization / 11909924374132684847 / -00081-of-00120 .json,错误:未找到:Google存储文件gs://cdf/binaries/denormailization/11909924374132684847/-00081-of-00120.json

Job id: 2015-10-25_21_01_46-11909924374132686437

工作ID:2015-10-25_21_01_46-11909924374132686437

1 个解决方案

#1


0  

Probably a missing file.

可能是一个丢失的文件。

Not found: Google Storage File gs://cdf/binaries/denormailization/11909924374132684847/-00081-of-00120.json

找不到:Google存储文件gs://cdf/binaries/denormailization/11909924374132684847/-00081-of-00120.json

#1


0  

Probably a missing file.

可能是一个丢失的文件。

Not found: Google Storage File gs://cdf/binaries/denormailization/11909924374132684847/-00081-of-00120.json

找不到:Google存储文件gs://cdf/binaries/denormailization/11909924374132684847/-00081-of-00120.json