We have some functions that process the elements from a bundle in batches. They need to output the last batch in the finishBundle() method.
我们有一些函数可以批量处理bundle中的元素。他们需要在finishBundle()方法中输出最后一批。
Something like described in the answer to this previous question.
在上一个问题的答案中描述的东西。
In the latest Dataflow 2.0.0-beta1 release, which is based on Beam 0.4.0, the DoFnTester throws UnsupportedOperationException from its finishBundle() method if the function under test invokes the output method on the context there.
在最新的Dataflow 2.0.0-beta1版本(基于Beam 0.4.0)中,如果被测函数在上下文中调用输出方法,则DoFnTester会从其finishBundle()方法抛出UnsupportedOperationException。
Is there any reason for this behavior change? Is output from DoFn.finishBundle() not supported anymore during runtime?
这种行为改变有什么理由吗?在运行时期间不再支持DoFn.finishBundle()的输出吗?
1 个解决方案
#1
0
This is a regression in DoFnTester. I've filed a bug against Beam here
这是DoFnTester中的回归。我在这里提出了一个针对Beam的错误
#1
0
This is a regression in DoFnTester. I've filed a bug against Beam here
这是DoFnTester中的回归。我在这里提出了一个针对Beam的错误