SparkSQL2.4.6 报错:org/codehaus/janino/InternalCompilerException

时间:2025-03-30 16:58:42

SparkSQL中执行了Dataset的action操作出现下面的异常:

Exception in thread "main" : org/codehaus/janino/InternalCompilerException
    at $.create(:197)
    at $.create(:36)
    at (:1321)
    at $apache$spark$sql$Dataset$$collectFromPlan(:3272)
    at $$anonfun$head$(:2484)
    at $$anonfun$head$(:2484)
    at $$anonfun$(:3254)
    at $.withNewExecutionId(:77)
    at (:3253)
    at (:2484)
    at (:2698)
    at (:254)
    at (:723)
    at (:682)
    at (:691)
    at $.main(:32)
    at ()
Caused by: : 
    at (:381)
    at (:424)
    at $(:349)
    at (:357)
    ... 17 more

解决办法:在POM文件中加入依赖:

    <dependency>
      <groupId></groupId>
      <artifactId>janino</artifactId>
      <version>3.0.8</version>
    </dependency>