spark 2.1.1:解析的JSON值与类构造函数不匹配

时间:2021-08-22 20:50:17

I've a strange problem with spark 2.1.1 and json4s.jackson.

我对spark 2.1.1和json4s.jackson有一个奇怪的问题。

I upgraded my streaming project from spark 1.5.1. Now when I execute code in IDE everything works fine.

我从spark 1.5.1升级了我的流媒体项目。现在,当我在IDE中执行代码时,一切正常。

But after assembly and code standalone execution with spark-submit

但是在使用spark-submit进行汇编和代码独立执行之后

I got the following error

我收到以下错误

Caused by: org.json4s.package$MappingException: Parsed JSON values do not match with class constructor
args=
arg types=
constructor=  

My Environemnt:

我的Environemnt:

  • spark=2.1.1,
  • 火花= 2.1.1
  • scala=2.11,
  • 阶= 2.11,
  • json4s-jackson=3.2.11
  • json4s杰克逊= 3.2.11

Has somebody has faced the same problem before? If yes, how did you solve it?

以前有人遇到过同样的问题吗?如果是的话,你是如何解决的?

Many thanks.

非常感谢。

2 个解决方案

#1


1  

Seems Like json4s-jackson bug search in following link "Parsed JSON values do not match with class constructor"

看起来像json4s-jackson bug搜索以下链接“Parsed JSON值与类构造函数不匹配”

https://recordnotfound.com/json4s-json4s-3177/issues

https://recordnotfound.com/json4s-json4s-3177/issues

You need to modify your json

你需要修改你的json

#2


0  

Upgrade to latest Spark vesrion 2.2.x solved the problem. Looks like bug in Spark 2.1.x fixed now in Spark 2.2.x

升级到最新的Spark vesrion 2.2.x解决了这个问题。看起来Spark 2.1.x中的错误现在已经在Spark 2.2.x中修复了

#1


1  

Seems Like json4s-jackson bug search in following link "Parsed JSON values do not match with class constructor"

看起来像json4s-jackson bug搜索以下链接“Parsed JSON值与类构造函数不匹配”

https://recordnotfound.com/json4s-json4s-3177/issues

https://recordnotfound.com/json4s-json4s-3177/issues

You need to modify your json

你需要修改你的json

#2


0  

Upgrade to latest Spark vesrion 2.2.x solved the problem. Looks like bug in Spark 2.1.x fixed now in Spark 2.2.x

升级到最新的Spark vesrion 2.2.x解决了这个问题。看起来Spark 2.1.x中的错误现在已经在Spark 2.2.x中修复了