Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache spark 如何在JAVA中将RDD转换为数据流?_Apache Spark - Fatal编程技术网

Apache spark 如何在JAVA中将RDD转换为数据流?

Apache spark 如何在JAVA中将RDD转换为数据流?,apache-spark,Apache Spark,我已经检查过了,想用JAVA做同样的事情。正确的方法是什么?根据javadoc,您可以这样做 //Create list List<SomePojo> somePojoList = ...; //Create rdd JavaRDD<SomePojo> rdd = streamingContext.sparkContext().parallelize( somePojoList); java.util.Queue<Java

我已经检查过了,想用JAVA做同样的事情。正确的方法是什么?

根据javadoc,您可以这样做

//Create list
List<SomePojo> somePojoList = ...;             

//Create rdd
JavaRDD<SomePojo> rdd = streamingContext.sparkContext().parallelize( somePojoList);
        java.util.Queue<JavaRDD<SomePojo>> queue = new LinkedList<JavaRDD<SomePojo>>();
        queue.add( rdd );
        JavaDStream<SomePojo> machineDataDstream = streamingContext.queueStream( queue );
//创建列表
列出somePojoList=。。。;
//创建rdd
JavaRDD rdd=streamingContext.sparkContext().parallelize(somePojoList);
java.util.Queue Queue=新建LinkedList();
队列添加(rdd);
JavaDStream MachinedataStream=streamingContext.queueStream(队列);