Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Python 从pyspark数据帧中提取架构标签_Python_Apache Spark_Pyspark - Fatal编程技术网

Python 从pyspark数据帧中提取架构标签

Python 从pyspark数据帧中提取架构标签,python,apache-spark,pyspark,Python,Apache Spark,Pyspark,我想从pyspark数据框架创建一个python列表,其中包含特定模式“级别”的模式标签 模式是: root |-- DISPLAY: struct (nullable = true) | |-- 1WO: struct (nullable = true) | | |-- JPY: struct (nullable = true) | | | |-- CHANGE24HOUR: string (nullable = true) | | |

我想从pyspark数据框架创建一个python列表,其中包含特定模式“级别”的模式标签

模式是:

root
 |-- DISPLAY: struct (nullable = true)
 |    |-- 1WO: struct (nullable = true)
 |    |    |-- JPY: struct (nullable = true)
 |    |    |    |-- CHANGE24HOUR: string (nullable = true)
 |    |    |    |-- CHANGEDAY: string (nullable = true)
 |    |-- AAVE: struct (nullable = true)
 |    |    |-- JPY: struct (nullable = true)
 |    |    |    |-- CHANGE24HOUR: string (nullable = true)
 |    |    |    |-- CHANGEDAY: string (nullable = true)
预期产出为:

list = 1WO, AAVE
以下代码打印架构中的所有内容:

df.schema.jsonValue()

有没有一种简单的方法可以提取这些标签?

使用星号符号选择第一层,然后在n中列出列:

df.选择('DISPLAY.*')。列