Apache spark Spark结构化流:未指定路径错误
试图使用Spark结构化流媒体将数据写入Kafka主题,出现以下错误Apache spark Spark结构化流:未指定路径错误,apache-spark,apache-kafka,spark-structured-streaming,Apache Spark,Apache Kafka,Spark Structured Streaming,试图使用Spark结构化流媒体将数据写入Kafka主题,出现以下错误 聚合数据集 .select(to_json(struct(“*”).as(“value”)) .writeStream() .outputMode(outputMode.Append()) .option(“kafka.bootstrap.servers”,kafkaBootstrapServersString) .选项(“主题”,主题) .选项(“检查点位置”,检查点位置) .start(); 堆栈跟踪: Exceptio
聚合数据集
.select(to_json(struct(“*”).as(“value”))
.writeStream()
.outputMode(outputMode.Append())
.option(“kafka.bootstrap.servers”,kafkaBootstrapServersString)
.选项(“主题”,主题)
.选项(“检查点位置”,检查点位置)
.start();
堆栈跟踪:
Exception in thread "main" java.lang.IllegalArgumentException: 'path' is not specified
at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$11.apply(DataSource.scala:276)
at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$11.apply(DataSource.scala:276)
at scala.collection.MapLike$class.getOrElse(MapLike.scala:128)
at org.apache.spark.sql.catalyst.util.CaseInsensitiveMap.getOrElse(CaseInsensitiveMap.scala:28)
at org.apache.spark.sql.execution.datasources.DataSource.createSink(DataSource.scala:275)
at org.apache.spark.sql.streaming.DataStreamWriter.start(DataStreamWriter.scala:286)
在您的writeStream节中,缺少格式,在您的情况下,似乎是kafka
aggregatedDataset
...
.writeStream
.format("kafka")
...
希望这有帮助 在您的writeStream部分格式缺失,在您的情况下,似乎是卡夫卡
aggregatedDataset
...
.writeStream
.format("kafka")
...
希望这有帮助 缺少
.format(“卡夫卡”)
很好的捕获。这就是我所缺少的:(缺少.format(“卡夫卡”)
很好的捕捉。这就是我所缺少的:(