Apache spark Apache Spark RDD转置

Apache spark Apache Spark RDD转置,apache-spark,transpose,Apache Spark,Transpose,我正在对证券市场数据进行ETL,以生成自组织图。我想转置行数据: AAME,20030101,1.63,1.63,1.63,1.63,1.63,0 AAON,20030101,5.4635,5.4635,5.4635,5.4635,5.4635,0 AAPL,20030101,7.165,7.165,7.165,7.165,7.165,0 ABAX,20030101,3.96,3.96,3.96,3.96,0 ... 祖姆兹,2013110429.55,29.79,29.18,29.462181

我正在对证券市场数据进行ETL,以生成自组织图。我想转置行数据:

AAME,20030101,1.63,1.63,1.63,1.63,1.63,0 AAON,20030101,5.4635,5.4635,5.4635,5.4635,5.4635,0 AAPL,20030101,7.165,7.165,7.165,7.165,7.165,0 ABAX,20030101,3.96,3.96,3.96,3.96,0 ... 祖姆兹,2013110429.55,29.79,29.18,29.46218100

进入列数据:

AAME 1.63,1.65。。。 AAON 5.4635,5.3

我应该尝试使用ReduceByKey(扩展)还是ReduceByKey(追加)我应该尝试使用BlockMatrix吗

例如:

val matA: BlockMatrix = coordMat.toBlockMatrix().cache()

// Validate whether the BlockMatrix is set up properly. Throws an Exception when it is not valid.
// Nothing happens if it is valid.
matA.validate()

// Calculate A^T A.
val ata = matA.transpose.multiply(matA)