Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Java 如何使用Spark Structured Streaming 2.1.1读取Avro数据并将Avro字段放入数据帧列?_Java_Apache Spark_Apache Spark Sql - Fatal编程技术网

Java 如何使用Spark Structured Streaming 2.1.1读取Avro数据并将Avro字段放入数据帧列?

Java 如何使用Spark Structured Streaming 2.1.1读取Avro数据并将Avro字段放入数据帧列?,java,apache-spark,apache-spark-sql,Java,Apache Spark,Apache Spark Sql,来自网站的代码 DataSet<Row> ds = sparkSession.readStream() .format("com.databricks.spark.avro") .option("avroSchema", schema.toString) .load(); 数据集ds=sparkSession.readStream() .format(“com.databricks.spark.avro”) .option(“avroSchema”,schema.toS

来自网站的代码

DataSet<Row> ds = sparkSession.readStream()
  .format("com.databricks.spark.avro")
  .option("avroSchema", schema.toString)
  .load();
数据集ds=sparkSession.readStream() .format(“com.databricks.spark.avro”) .option(“avroSchema”,schema.toString) .load(); 因为Avro消息有字段。我想知道如何将消息的每个字段放在DataSet/Dataframe的单独列中?上面的代码是否自动执行此操作