Java中的Spark Graphx
我正在用JavaAPI准备图形,并在下面转换为Java中的Spark Graphx,java,apache-spark,spark-graphx,Java,Apache Spark,Spark Graphx,我正在用JavaAPI准备图形,并在下面转换为Edge,但编码器给Edge类提供了原始参数 Dataset<Row> edges = spark.read() .option("header", "true") .option("inferSchema", "true") .csv("src/main/resources/edges.csv"); Encoder<Ed
Edge
,但编码器给Edge
类提供了原始参数
Dataset<Row> edges = spark.read()
.option("header", "true")
.option("inferSchema", "true")
.csv("src/main/resources/edges.csv");
Encoder<Edge> encoderEdges = Encoders.bean(Edge.class);
JavaRDD<Edge> edgesRDD = edges.as(encoderEdges).toJavaRDD();
ClassTag<String> stringTag = scala.reflect.ClassTag$.MODULE$.apply(String.class);
ClassTag<Double> doubleTag = scala.reflect.ClassTag$.MODULE$.apply(Double.class);
Graph<Double, String> graph = Graph.apply(verticesRDD.rdd(),
edgesRDD.rdd(), Double.class,
StorageLevel.MEMORY_ONLY(),
StorageLevel.MEMORY_ONLY(),
doubleTag, stringTag);
Dataset edges=spark.read()
.选项(“标题”、“正确”)
.选项(“推断模式”、“真”)
.csv(“src/main/resources/edges.csv”);
编码器encoderEdges=Encoders.bean(Edge.class);
JavaRDD edgesRDD=edges.as(encoderEdges.toJavaRDD();
ClassTag stringTag=scala.reflect.ClassTag$.MODULE$.apply(String.class);
ClassTag doubleTag=scala.reflect.ClassTag$.MODULE$.apply(Double.class);
Graph=Graph.apply(verticesRDD.rdd(),
edgesRDD.rdd(),Double.class,
StorageLevel.MEMORY_ONLY(),
StorageLevel.MEMORY_ONLY(),
双标签,stringTag);
如何转换为所需格式,错误是
该方法适用于(RDD>、RDD>、VD、,
类型中的StorageLevel、StorageLevel、ClassTag、ClassTag)
图表不适用于参数(RDD>,
RDD、字符串、StorageLevel、StorageLevel、ClassTag、,
类标签)
试着用画框。另一个有用的线程。