Scala 删除Dataframe中特定行中的空值并合并行

需要使用Scala在Spark数据帧中执行以下活动。 已经尝试过做一些基本的过滤器isNotNull条件等。但是没有运气

输入

+----------+----------+----------+
|琥珀色|绿色|红色|
+----------+----------+----------+
|空|空|[AE，AA，CV]|
|空|[AH，EE，CC]|空|
|[DD，DE，QQ]|空|空|
+----------+----------+----------+

输出

+----------+----------+----------+
|琥珀色|绿色|红色|
+----------+----------+----------+
|[DD，DE，QQ]|[AH，EE，CC]|[AE，AA，CV]|
+----------+----------+----------+

如果输入数据帧仅限于

+----------+----------+----------+
|     Amber|     Green|       Red|
+----------+----------+----------+
|      null|      null|[AE,AA,CV]|
|      null|[AH,EE,CC]|      null|
|[DD,DE,QQ]|      null|      null|
+----------+----------+----------+

然后执行以下操作将获得所需的最终数据帧

你应该得到

+------------+------------+------------+
|Amber       |Green       |Red         |
+------------+------------+------------+
|[DD, DE, QQ]|[AH, EE, CC]|[AE, AA, CV]|
+------------+------------+------------+

collect\u list

内置函数忽略

null

值

+------------+------------+------------+
|Amber       |Green       |Red         |
+------------+------------+------------+
|[DD, DE, QQ]|[AH, EE, CC]|[AE, AA, CV]|
+------------+------------+------------+