Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache spark Spark连接到Kafka获取错误_Apache Spark_Streaming_Apache Kafka - Fatal编程技术网

Apache spark Spark连接到Kafka获取错误

Apache spark Spark连接到Kafka获取错误,apache-spark,streaming,apache-kafka,Apache Spark,Streaming,Apache Kafka,为什么spark提交时会出现java.lang.NoClassDefFoundError错误? stacktrace如下所示 [appadm@elk01 spark]$ bin/spark-submit --class "com.ipponusa.SparkStringConsumer" --master localhost:9092 samples/my-app-1.0-SNAPSHORT.jar 1 Hello Exception in thread "main" java.lang.NoC

为什么spark提交时会出现
java.lang.NoClassDefFoundError
错误? stacktrace如下所示

[appadm@elk01 spark]$ bin/spark-submit --class "com.ipponusa.SparkStringConsumer" --master localhost:9092 samples/my-app-1.0-SNAPSHORT.jar 1
Hello
Exception in thread "main" java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class
        at kafka.utils.Pool.<init>(Pool.scala:26)
        at kafka.consumer.FetchRequestAndResponseStatsRegistry$.<init>(FetchRequestAndResponseStats.scala:61)
        at kafka.consumer.FetchRequestAndResponseStatsRegistry$.<clinit>(FetchRequestAndResponseStats.scala)
        at kafka.consumer.SimpleConsumer.<init>(SimpleConsumer.scala:44)
        at org.apache.spark.streaming.kafka.KafkaCluster.connect(KafkaCluster.scala:52)
        at org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$org$apache$spark$streaming$kafka$KafkaCluster$$withBrokers$1.apply(KafkaCluster.scala:345)
        at org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$org$apache$spark$streaming$kafka$KafkaCluster$$withBrokers$1.apply(KafkaCluster.scala:342)
[appadm@elk01spark]$bin/spark submit--class“com.ipponusa.SparkStringConsumer”--master localhost:9092 samples/my-app-1.0-SNAPSHORT.jar 1
你好
线程“main”java.lang.NoClassDefFoundError中出现异常:scala/collection/GenTraversableOnce$class
在kafka.utils.Pool.(Pool.scala:26)
在kafka.consumer.FetchRequestAndResponseStatsRegistry$(FetchRequestAndResponseStats.scala:61)
位于kafka.consumer.FetchRequestAndResponseStatsRegistry$。(FetchRequestAndResponseStats.scala)
在卡夫卡。消费者。简单消费者。(简单消费者。斯卡拉:44)
位于org.apache.spark.streaming.kafka.KafkaCluster.connect(KafkaCluster.scala:52)
在org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$org$apache$spark$streaming$kafka$KafkaCluster$$withBrokers$1.apply(KafkaCluster.scala:345)
位于org.apache.spark.streaming.kafka.KafkaCluster$$anonfun$org$apache$spark$streaming$kafka$KafkaCluster$$withBrokers$1.apply(KafkaCluster.scala:342)

您必须使用与编写Spark代码的Scala版本相同的Scala版本。检查它们,您可能需要降级您的Scala版本。

您编译的Scala版本是哪个?