elasticsearch,apache-spark,spark-streaming,Scala,elasticsearch,Apache Spark,Spark Streaming" /> elasticsearch,apache-spark,spark-streaming,Scala,elasticsearch,Apache Spark,Spark Streaming" />

Scala 运行时带Spark的ElasticSearch-错误

Scala 运行时带Spark的ElasticSearch-错误,scala,elasticsearch,apache-spark,spark-streaming,Scala,elasticsearch,Apache Spark,Spark Streaming,运行ElasticSearch Spark示例代码时出错,我主要从[start page][1]获取该代码。 错误是: 线程“main”java.lang.NoSuchMethodError中出现异常: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;在 org.elasticsearch.spark.rdd.EsSpark$.saveToEs(EsSpark.scala:52) 这是我的sbt配置: scalaVers

运行ElasticSearch Spark示例代码时出错,我主要从[start page][1]获取该代码。 错误是:

线程“main”java.lang.NoSuchMethodError中出现异常: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;在 org.elasticsearch.spark.rdd.EsSpark$.saveToEs(EsSpark.scala:52)

这是我的sbt配置:

scalaVersion := "2.10.4"

resolvers += "Typesafe Repo" at "http://repo.typesafe.com/typesafe/releases/"
resolvers += "Conjars" at "http://conjars.org/repo"

resolvers += "cljars" at "https://clojars.org/repo/"

libraryDependencies += "org.apache.spark" %% "spark-core" % "1.5.0"
libraryDependencies += "org.apache.spark" % "spark-streaming_2.10" % "1.5.0"
libraryDependencies += "org.elasticsearch" % "elasticsearch" % "1.7.2"
libraryDependencies +="org.elasticsearch" % "elasticsearch-hadoop" % "2.1.1"
下面是失败的代码:(最后一行)

运行时使用:

bin/spark-submit --jars $(echo ../../elasticsearch-hadoop-2.1.1/dist/elasticsearch-spark-1.2_2.11-2.1.1.jar  | tr ' ' ',')  --class "Test"  --master local[4]   target/scala-2.10/simple-project_2.10-1.0.jar localhost 9999
我尝试将scala版本更改为2.11.4,但在编译时遇到了问题。
有什么想法吗?

您是否进行了正确的导入?
NoSuchMethodError
通常发生在方法在编译时可用时(即,在编译和链接代码时可以正确解析方法)但在运行时不再可用,因为1)相应的库不可用或2)部署主机上的库版本不同。当您导入org.elasticsearch.spark.rdd.EsSpark时会发生什么情况?
?我在spark 2.0-preview和es 2.3.3上遇到相同的错误,有谁能告诉我,是否可以将spark 2.0-preview与RDD一起使用以保存到ESHave您是否进行了正确的导入?
NoSuchMethodError
通常在编译时方法可用时发生(即,在编译和链接代码时可以正确解析该方法)但在运行时不再可用,因为1)相应的库不可用或2)部署主机上的库版本不同。当您导入org.elasticsearch.spark.rdd.EsSpark时会发生什么情况?
?我在spark 2.0-preview和es 2.3.3上遇到相同的错误,有谁能告诉我,是否可以使用spark 2.0-preview和RDD来保存到ES
bin/spark-submit --jars $(echo ../../elasticsearch-hadoop-2.1.1/dist/elasticsearch-spark-1.2_2.11-2.1.1.jar  | tr ' ' ',')  --class "Test"  --master local[4]   target/scala-2.10/simple-project_2.10-1.0.jar localhost 9999