Apache spark 如何将MapPartitionsRDD转换为数据帧?
我已从以下位置返回MapPartitionsRDD:Apache spark 如何将MapPartitionsRDD转换为数据帧?,apache-spark,pyspark,apache-spark-mllib,Apache Spark,Pyspark,Apache Spark Mllib,我已从以下位置返回MapPartitionsRDD: from pyspark.mllib.feature import Normalizer normalizer = Normalizer() rating = normalizer.transform(ratingRDD) print(rating) > MapPartitionsRDD[239] at mapPartitions at PythonMLLibAPI.scala:1522 如何将其转换为数据帧?试试: rating.
from pyspark.mllib.feature import Normalizer
normalizer = Normalizer()
rating = normalizer.transform(ratingRDD)
print(rating)
> MapPartitionsRDD[239] at mapPartitions at PythonMLLibAPI.scala:1522
如何将其转换为数据帧?试试:
rating.map(lambda x: (x, )).toDF()
此方法对MapPartitionsRDD甚至RDD类型不可用。