如何配置数据流管道以使用共享VPC?

时间:2022-09-10 15:37:41

I know we have configuration arguments where you can specify network and subnets, I tried doing that but with a Shared VPC network, it gives me this error.

我知道我们有配置参数,你可以指定网络和子网,我尝试这样做但是使用共享VPC网络,它给了我这个错误。

如何配置数据流管道以使用共享VPC?

2 个解决方案

#1


0  

Be sure to include the Project ID in the --subnetwork option:

确保在--subnetwork选项中包含项目ID:

/projects/<PROJECT_ID>/regions/<REGION>/subnetworks/<SUBNETWORK>

and give to the Dataflow Service account the Network User role in the host project, which is what I suspect is going on according to the error message.

并向数据流服务帐户提供主机项目中的网络用户角色,这是我怀疑根据错误消息进行的操作。

#2


0  

The usage of subnetworks in Cloud Dataflow require to specify the subnetwork parameter when running the pipeline; However, in the case of subnetwork that are located in a Shared VPC network, it is required to use the complete URL based on the following format:

Cloud Dataflow中子网的使用需要在运行管道时指定子网参数;但是,如果子网位于共享VPC网络中,则需要使用基于以下格式的完整URL:

https://www.googleapis.com/compute/v1/projects/<HOST_PROJECT>/regions/<REGION>/subnetworks/<SUBNETWORK>

Additionally, verify you are adding the project's Dataflow service account into the Shared VPC's project IAM table and give it the "Compute Network User" role permission in order to ensure that the service has the required access scope.

此外,验证您是否将项目的Dataflow服务帐户添加到共享VPC的项目IAM表中,并为其授予“计算网络用户”角色权限,以确保该服务具有所需的访问范围。

You can take a look on the Subnetwork parameter official Google's documentation that contains that contains detailed information about this matter.

您可以查看Subnetwork参数官方Google的文档,其中包含有关此事项的详细信息。

#1


0  

Be sure to include the Project ID in the --subnetwork option:

确保在--subnetwork选项中包含项目ID:

/projects/<PROJECT_ID>/regions/<REGION>/subnetworks/<SUBNETWORK>

and give to the Dataflow Service account the Network User role in the host project, which is what I suspect is going on according to the error message.

并向数据流服务帐户提供主机项目中的网络用户角色,这是我怀疑根据错误消息进行的操作。

#2


0  

The usage of subnetworks in Cloud Dataflow require to specify the subnetwork parameter when running the pipeline; However, in the case of subnetwork that are located in a Shared VPC network, it is required to use the complete URL based on the following format:

Cloud Dataflow中子网的使用需要在运行管道时指定子网参数;但是,如果子网位于共享VPC网络中,则需要使用基于以下格式的完整URL:

https://www.googleapis.com/compute/v1/projects/<HOST_PROJECT>/regions/<REGION>/subnetworks/<SUBNETWORK>

Additionally, verify you are adding the project's Dataflow service account into the Shared VPC's project IAM table and give it the "Compute Network User" role permission in order to ensure that the service has the required access scope.

此外,验证您是否将项目的Dataflow服务帐户添加到共享VPC的项目IAM表中,并为其授予“计算网络用户”角色权限,以确保该服务具有所需的访问范围。

You can take a look on the Subnetwork parameter official Google's documentation that contains that contains detailed information about this matter.

您可以查看Subnetwork参数官方Google的文档,其中包含有关此事项的详细信息。