Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache spark toDF()上的Null指针异常_Apache Spark - Fatal编程技术网

Apache spark toDF()上的Null指针异常

Apache spark toDF()上的Null指针异常,apache-spark,Apache Spark,在Map中,我选取了几列并尝试创建DF val列:List[caseclass\u Name]=List(caseclass(id,id))//案例类 val splDF=columns.toDF()//数据帧 错误: java.lang.NullPointerException 位于org.apache.spark.sql.SQLConf.getConf(SQLConf.scala:638) 位于org.apache.spark.sql.SQLConf.dataframeanalysis(S

在Map中,我选取了几列并尝试创建DF

val列:List[caseclass\u Name]=List(caseclass(id,id))//案例类
val splDF=columns.toDF()//数据帧
错误:

java.lang.NullPointerException
位于org.apache.spark.sql.SQLConf.getConf(SQLConf.scala:638)
位于org.apache.spark.sql.SQLConf.dataframeanalysis(SQLConf.scala:573)
位于org.apache.spark.sql.DataFrame(DataFrame.scala:132)
位于org.apache.spark.sql.DataFrame$.apply(DataFrame.scala:52)
位于org.apache.spark.sql.SQLContext.createDataFrame(SQLContext.scala:432)
在
org.apache.spark.sql.SQLImplicits.localSeqToDataFrameHolder(SQLImplicits.scala:164)
at package.ObjectName$.Method(Object_name.scala:322)
在)
在scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
在scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
在scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
在
org.apache.spark.sql.execution.aggregate.TungstengAggregationIterator.processInputs(TungstengAggregationIterator.scala:505)
在
org.apache.spark.sql.execution.aggregate.TungstengAggregationIterator.(TungstengAggregationIterator.scala:686)
在
org.apache.spark.sql.execution.aggregate.tungstengaggregate$$anonfun$doExecute$1$$anonfun$2.apply(tungstengaggregate.scala:95)

这似乎是相关的,但并不能解决问题: