云数据流作业输出是否是事务性的?

时间:2022-01-17 15:22:22

Assuming I don't know the job status that was supposed to generate some output files (in cloud store), can I assume that if some output files exist they contain all of the job's output? Or it's possible that partial output is visible?

假设我不知道应该生成一些输出文件的作业状态(在云存储中),我可以假设如果存在一些输出文件,它们包含所有作业的输出吗?或者部分输出可见?

Thanks, G

谢谢,G

1 个解决方案

#1


2  

It is possible that only a subset of the files is visible, but the visible files are complete (cannot grow or change).

可能只有一部分文件可见,但可见文件是完整的(无法增长或更改)。

The filenames contain the total number of files (output-XXXXX-of-NNNNN), so once you have one file, you know how many more to expect.

文件名包含文件总数(output-XXXXX-of-NNNNN),因此一旦有了一个文件,就会知道还有多少文件。

#1


2  

It is possible that only a subset of the files is visible, but the visible files are complete (cannot grow or change).

可能只有一部分文件可见,但可见文件是完整的(无法增长或更改)。

The filenames contain the total number of files (output-XXXXX-of-NNNNN), so once you have one file, you know how many more to expect.

文件名包含文件总数(output-XXXXX-of-NNNNN),因此一旦有了一个文件,就会知道还有多少文件。