how to develop Beam Pipeline locally on IDE and run on Dataflow? I want to use pycharm in my PC to develop Beam pipelines and run them on Dataflow. Are there any tutorials on how to do this?
如何在IDE上本地开发Beam Pipeline并在Dataflow上运行？我想在我的PC中使用pycharm来开发Beam管道并在Dataflow上运行它们。有没有关于如何做到这一点的教程？
1 个解决方案
#1
0
Set the parameter as : https://cloud.google.com/dataflow/pipelines/specifying-exec-params
将参数设置为：https：//cloud.google.com/dataflow/pipelines/specifying-exec-params
and try example as: https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/wordcount_minimal.py
并尝试示例：https：//github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/wordcount_minimal.py
#1
0
Set the parameter as : https://cloud.google.com/dataflow/pipelines/specifying-exec-params
将参数设置为：https：//cloud.google.com/dataflow/pipelines/specifying-exec-params
and try example as: https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/wordcount_minimal.py
并尝试示例：https：//github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/wordcount_minimal.py