Python 如何在pyspark中读取简单的字符串文本文件?
我有一个字符串列表保存在文本文件中,没有标题,我想在pyspark笔记本的databricks中打开并打印所有行Python 如何在pyspark中读取简单的字符串文本文件?,python,pyspark,azure-databricks,read-text,Python,Pyspark,Azure Databricks,Read Text,我有一个字符串列表保存在文本文件中,没有标题,我想在pyspark笔记本的databricks中打开并打印所有行 abcdef vcdfgrs vcvdfrs vfdedsew kgsldkflfdlfd text = sc.textFile("path.../filename.txt) print(text.collect()) 此代码不是打印行。谢谢你的帮助。开始了 #define a function which takes line and print def f(line
abcdef
vcdfgrs
vcvdfrs
vfdedsew
kgsldkflfdlfd
text = sc.textFile("path.../filename.txt)
print(text.collect())
此代码不是打印行。谢谢你的帮助。开始了
#define a function which takes line and print
def f(line):
print(line)
#building the text file via list
my_list = [['my text line-1'],['line-2 text2 my2'],['some junk line-3']]
#create RDD via list (you have it via
txt_file = sc.parallelize(my_list)
#use for each to call the function and print will work
txt_file.foreach(f)
#if you want each word via line, use flatmap