Complex Cloud Dataflow管道不会在开发人员控制台中显示执行图

时间:2022-06-06 23:13:46

We are implementing a fairly complex pipeline composed of several GroupBy and Combine chained together. In addition to that, the pipeline it's also applying a KeyedPCollectionTuple.

我们正在实现一个相当复杂的管道,该管道由多个GroupBy和Combine链接在一起组成。除此之外,管道还应用了KeyedPCollectionTuple。

This pipeline executes successfully however the graph doesn't show in the Google developer's console. Only the logs are shown. The steps are also missing.

此管道已成功执行,但图表未显示在Google开发人员的控制台中。仅显示日志。这些步骤也缺失了。

Is there any way of get them to show?

有没有办法让他们展示?

1 个解决方案

#1


7  

This is caused by a failure to display graphs if any of the transforms have an assigned name which is empty.

这是由于如果任何转换的指定名称为空,则无法显示图形。

Github issue #58 has been created to address this issue.

已经创建了Github问题#58来解决这个问题。

In the meantime, look at your code and make sure any invocation of .apply(name, transform) never has an empty name string, or a name starting with a / character. Also make sure that any uses of setName and named satisfy these requirements.

在此期间,查看您的代码并确保.apply(name,transform)的任何调用都不会有空名称字符串,或者以/字符开头的名称。还要确保setName和named的任何使用都满足这些要求。

#1


7  

This is caused by a failure to display graphs if any of the transforms have an assigned name which is empty.

这是由于如果任何转换的指定名称为空,则无法显示图形。

Github issue #58 has been created to address this issue.

已经创建了Github问题#58来解决这个问题。

In the meantime, look at your code and make sure any invocation of .apply(name, transform) never has an empty name string, or a name starting with a / character. Also make sure that any uses of setName and named satisfy these requirements.

在此期间,查看您的代码并确保.apply(name,transform)的任何调用都不会有空名称字符串,或者以/字符开头的名称。还要确保setName和named的任何使用都满足这些要求。