Cloud Dataflow中的“侧面输入”是否支持从BigQuery视图读取?

时间:2021-07-24 14:57:16

Tried to point a side-input to a BigQuery view, instead of directly to a BigQuery table. It does not produce an error, but simply returns 0 rows. View works fine inside BigQuery.

试图将侧输入指向BigQuery视图,而不是直接指向BigQuery表。它不会产生错误,但只返回0行。 View在BigQuery中运行良好。

For example, given a view referencing a table 'types_test' with just 1 row:

例如,给定一个只引用1行的表'types_test'的视图:

Cloud Dataflow中的“侧面输入”是否支持从BigQuery视图读取?

In BigQuery, it works fine:

在BigQuery中,它工作正常:

Cloud Dataflow中的“侧面输入”是否支持从BigQuery视图读取?

But using the view as a side-input in Dataflow return 0 rows:

但是使用视图作为Dataflow中的side-input返回0行:

INFO: Reading from BigQuery table <removed>:CPT_7414_PLAYGROUND.view_test
Mar 20, 2015 11:10:08 PM com.google.cloud.dataflow.sdk.io.BigQueryIO evaluateReadHelper
INFO: Number of records read from BigQuery: 0

Do side-inputs support views in BigQuery, or do you need to do something else to use a view for a side-input?

在BigQuery中进行侧输入支持视图,还是需要做其他事情来使用视图进行侧输入?

1 个解决方案

#1


1  

Found in the FAQ's, that views are not currently supported.

在FAQ中找到,目前不支持这些视图。

http://goo.gl/ZVNTnp

http://goo.gl/ZVNTnp

#1


1  

Found in the FAQ's, that views are not currently supported.

在FAQ中找到,目前不支持这些视图。

http://goo.gl/ZVNTnp

http://goo.gl/ZVNTnp