Scala Spark MLLIB错误：java.lang.NoSuchMethodError:org.apache.Spark.rdd.rdd.treeAggergegate

我试图在Spark作业中运行线性回归示例。我得到了以下错误：

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.rdd.RDD.treeAggregate$default$4(Ljava/lang/Object;)I
    at org.apache.spark.mllib.optimization.GradientDescent$$anonfun$runMiniBatchSGD$1.apply$mcVI$sp(GradientDescent.scala:189)
    at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
    at org.apache.spark.mllib.optimization.GradientDescent$.runMiniBatchSGD(GradientDescent.scala:184)
    at org.apache.spark.mllib.optimization.GradientDescent.optimize(GradientDescent.scala:107)
    at org.apache.spark.mllib.regression.GeneralizedLinearAlgorithm.run(GeneralizedLinearAlgorithm.scala:267)
    at org.apache.spark.mllib.regression.GeneralizedLinearAlgorithm.run(GeneralizedLinearAlgorithm.scala:190)
    at com.myproject.sample.LinearRegression$.run(LinearRegressionExample.scala:105)
    at com.myproject.sample.LinearRegression$$anonfun$main$1.apply(LinearRegressionExample.scala:67)
    at com.myproject.sample.LinearRegression$$anonfun$main$1.apply(LinearRegressionExample.scala:66)
    at scala.Option.map(Option.scala:145)
    at com.myproject.sample.LinearRegression$.main(LinearRegressionExample.scala:66)
    at com.myproject.sample.LinearRegression.main(LinearRegressionExample.scala)

---

以下是我在pom中的依赖项：

    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-mllib_2.10</artifactId>
        <version>1.3.1</version>
    </dependency>

    <dependency> 
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-core_2.10</artifactId>
        <version>1.2.0</version>
        <exclusions>
         :
         :
    </dependency>

org.apache.spark
spark-mllib_2.10
1.3.1
org.apache.spark
spark-core_2.10
1.2.0
:
:

---

---

为什么我得到java.lang.NoSuchMethodError:org.apache.spark.rdd.rdd.treeAggregate？我是否使用了错误的依赖项？谢谢

你应该拥有所有spark库的相同版本。我明白了。将spark-core_2.10更改为1.3.1现在可以工作了。谢谢