I'm making dataflow pipeline with python.
I want to share global variables across pipeline transform and across worker nodes like global variables (across multiple workers).
Is there any way to support this? thanx in advance
我正在用python制作数据流管道。我想在管道转换和工作节点之间共享全局变量，如全局变量（跨多个工作者）。有没有办法支持这个？提前
1 个解决方案
#1
1
Stateful processing may be of use for sharing state between workers of a specific node (would not be able to share between transforms though): https://beam.apache.org/blog/2017/02/13/stateful-processing.html
有状态处理可能用于在特定节点的工作者之间共享状态（虽然不能在变换之间共享）：https：//beam.apache.org/blog/2017/02/13/stateful-processing.html
#1
1
Stateful processing may be of use for sharing state between workers of a specific node (would not be able to share between transforms though): https://beam.apache.org/blog/2017/02/13/stateful-processing.html
有状态处理可能用于在特定节点的工作者之间共享状态（虽然不能在变换之间共享）：https：//beam.apache.org/blog/2017/02/13/stateful-processing.html