Apache spark Spark结构化流:未指定路径错误

Apache spark Spark结构化流:未指定路径错误,apache-spark,apache-kafka,spark-structured-streaming,Apache Spark,Apache Kafka,Spark Structured Streaming,试图使用Spark结构化流媒体将数据写入Kafka主题,出现以下错误 聚合数据集 .select(to_json(struct(“*”).as(“value”)) .writeStream() .outputMode(outputMode.Append()) .option(“kafka.bootstrap.servers”,kafkaBootstrapServersString) .选项(“主题”,主题) .选项(“检查点位置”,检查点位置) .start(); 堆栈跟踪: Exceptio

试图使用Spark结构化流媒体将数据写入Kafka主题,出现以下错误

聚合数据集
.select(to_json(struct(“*”).as(“value”))
.writeStream()
.outputMode(outputMode.Append())
.option(“kafka.bootstrap.servers”,kafkaBootstrapServersString)
.选项(“主题”,主题)
.选项(“检查点位置”,检查点位置)
.start();
堆栈跟踪:

Exception in thread "main" java.lang.IllegalArgumentException: 'path' is not specified
    at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$11.apply(DataSource.scala:276)
    at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$11.apply(DataSource.scala:276)
    at scala.collection.MapLike$class.getOrElse(MapLike.scala:128)
    at org.apache.spark.sql.catalyst.util.CaseInsensitiveMap.getOrElse(CaseInsensitiveMap.scala:28)
    at org.apache.spark.sql.execution.datasources.DataSource.createSink(DataSource.scala:275)
    at org.apache.spark.sql.streaming.DataStreamWriter.start(DataStreamWriter.scala:286)

在您的writeStream节中,缺少格式,在您的情况下,似乎是kafka

 aggregatedDataset
    ...
    .writeStream
    .format("kafka")
    ...

希望这有帮助

在您的writeStream部分格式缺失,在您的情况下,似乎是卡夫卡

 aggregatedDataset
    ...
    .writeStream
    .format("kafka")
    ...

希望这有帮助

缺少
.format(“卡夫卡”)
很好的捕获。这就是我所缺少的:(缺少
.format(“卡夫卡”)
很好的捕捉。这就是我所缺少的:(