I've a strange problem with spark 2.1.1
and json4s.jackson
.
我对spark 2.1.1和json4s.jackson有一个奇怪的问题。
I upgraded my streaming project from spark 1.5.1
. Now when I execute code in IDE everything works fine.
我从spark 1.5.1升级了我的流媒体项目。现在,当我在IDE中执行代码时,一切正常。
But after assembly
and code standalone execution with spark-submit
但是在使用spark-submit进行汇编和代码独立执行之后
I got the following error
我收到以下错误
Caused by: org.json4s.package$MappingException: Parsed JSON values do not match with class constructor
args=
arg types=
constructor=
My Environemnt:
我的Environemnt:
- spark=2.1.1,
- 火花= 2.1.1
- scala=2.11,
- 阶= 2.11,
- json4s-jackson=3.2.11
- json4s杰克逊= 3.2.11
Has somebody has faced the same problem before? If yes, how did you solve it?
以前有人遇到过同样的问题吗?如果是的话,你是如何解决的?
Many thanks.
非常感谢。
2 个解决方案
#1
1
Seems Like json4s-jackson bug search in following link "Parsed JSON values do not match with class constructor"
看起来像json4s-jackson bug搜索以下链接“Parsed JSON值与类构造函数不匹配”
https://recordnotfound.com/json4s-json4s-3177/issues
https://recordnotfound.com/json4s-json4s-3177/issues
You need to modify your json
你需要修改你的json
#2
0
Upgrade to latest Spark vesrion 2.2.x solved the problem. Looks like bug in Spark 2.1.x fixed now in Spark 2.2.x
升级到最新的Spark vesrion 2.2.x解决了这个问题。看起来Spark 2.1.x中的错误现在已经在Spark 2.2.x中修复了
#1
1
Seems Like json4s-jackson bug search in following link "Parsed JSON values do not match with class constructor"
看起来像json4s-jackson bug搜索以下链接“Parsed JSON值与类构造函数不匹配”
https://recordnotfound.com/json4s-json4s-3177/issues
https://recordnotfound.com/json4s-json4s-3177/issues
You need to modify your json
你需要修改你的json
#2
0
Upgrade to latest Spark vesrion 2.2.x solved the problem. Looks like bug in Spark 2.1.x fixed now in Spark 2.2.x
升级到最新的Spark vesrion 2.2.x解决了这个问题。看起来Spark 2.1.x中的错误现在已经在Spark 2.2.x中修复了