Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
scala-如何将数据帧的列与concat_ws连接起来?_Scala_Apache Spark_Dataframe_Apache Spark Sql - Fatal编程技术网

scala-如何将数据帧的列与concat_ws连接起来?

scala-如何将数据帧的列与concat_ws连接起来?,scala,apache-spark,dataframe,apache-spark-sql,Scala,Apache Spark,Dataframe,Apache Spark Sql,我想连接数据帧的列。我编写了一个Udf来实现这一点,但正如我所看到的,concat\u ws在传递它时需要列Array[String]。如何正确传递数据帧的列 val columns = salesDF.columns val concatColumns = udf((arr: Seq[String]) => arr.mkString(" ")) salesDF.select(concat_ws(",", concatColumns(columns))) 您只需将选择作为数组[列]传递

我想连接数据帧的列。我编写了一个Udf来实现这一点,但正如我所看到的,
concat\u ws
在传递它时需要列
Array[String]
。如何正确传递数据帧的列

val columns = salesDF.columns
val concatColumns = udf((arr: Seq[String]) => arr.mkString(" "))

salesDF.select(concat_ws(",", concatColumns(columns)))

您只需将选择作为
数组[列]
传递:

import org.apache.spark.sql.functions.{col,concat_ws}

val selection = salesDF.columns.map(col)
salesDF.select(concat_ws(",", selection : _*))