两样本Kolmogorov-Smirnov检验SCALA误差

两样本Kolmogorov-Smirnov检验SCALA误差,scala,apache-spark,apache-spark-sql,kolmogorov-smirnov,Scala,Apache Spark,Apache Spark Sql,Kolmogorov Smirnov,我试图用分布[6,6]计算SCALA中的de kolmogorov-Smirnov检验,假设在原始分布中,所有的值都是相同的p(6)=1。这就是我尝试的方式: val data: RDD[Double] = sc.parallelize(Seq(6, 6)) val myCDF = Map(6 -> 1) val testResult2 = Statistics.kolmogorovSmirnovTest(data, myCDF) println(testResult2) 这是我得到的错

我试图用分布[6,6]计算SCALA中的de kolmogorov-Smirnov检验,假设在原始分布中,所有的值都是相同的p(6)=1。这就是我尝试的方式:

val data: RDD[Double] = sc.parallelize(Seq(6, 6))
val myCDF = Map(6 -> 1)
val testResult2 = Statistics.kolmogorovSmirnovTest(data, myCDF)
println(testResult2)
这是我得到的错误:

notebook:3: error: overloaded method value kolmogorovSmirnovTest with alternatives:   (data: org.apache.spark.api.java.JavaDoubleRDD,distName: String,params: Double*)org.apache.spark.mllib.stat.test.KolmogorovSmirnovTestResult <and>   (data: org.apache.spark.rdd.RDD[Double],distName: String,params: Double*)org.apache.spark.mllib.stat.test.KolmogorovSmirnovTestResult <and>   (data: org.apache.spark.rdd.RDD[Double],cdf: Double => Double)org.apache.spark.mllib.stat.test.KolmogorovSmirnovTestResult  cannot be applied to (org.apache.spark.rdd.RDD[Double], scala.collection.immutable.Map[Int,Int]) val testResult2 = Statistics.kolmogorovSmirnovTest(data, myCDF)
notebook:3:错误:重载方法值kolmogorovSmirnovTest和可选项:(数据:org.apache.spark.api.java.JavaDoubleRDD,distName:String,params:Double*)org.apache.spark.mllib.stat.test.KolmogorovSmirnovTestResult(数据:org.apache.spark.rdd.rdd[Double],distName:String,params:Double*))org.apache.spark.mllib.stat.test.KolmogorovSmirnovTestResult(数据:org.apache.spark.rdd.rdd[Double],cdf:Double=>Double)org.apache.spark.mllib.stat.test.kolmogorovsmirnovstresult不能应用于(org.apache.spark.spark.rdd.rdd[Double],scala.collection.immutable.Map[Int],Int])testResult2=Statistics.kolmogorovsmirnovsmirnovstresult(数据
有人知道它为什么不起作用吗? 另外,您知道是否可以在PySpark中执行此操作吗?或者我必须从PySpark中提取SCALA代码?
谢谢

这和Pypark有什么关系吗?@Andreytukin,我想他是在用jupyter跑步。Spark在这里做什么?它在一堆Spark虚拟机上跑步。