Javascript 齐柏林飞艇:运行多个段落
我正试图用齐柏林飞艇绘制一个实时图形。为此,我正在使用(spark 2.1.0,zeppelin 0.7)开发结构化流数据帧,如下示例: 但是当我运行流段落时(定义图表) (图表段落)仍为“待定” 我的(定义图表)段落代码为:Javascript 齐柏林飞艇:运行多个段落,javascript,scala,highcharts,apache-zeppelin,apache-spark-2.0,Javascript,Scala,Highcharts,Apache Zeppelin,Apache Spark 2.0,我正试图用齐柏林飞艇绘制一个实时图形。为此,我正在使用(spark 2.1.0,zeppelin 0.7)开发结构化流数据帧,如下示例: 但是当我运行流段落时(定义图表) (图表段落)仍为“待定” 我的(定义图表)段落代码为: import com.knockdata.spark.highcharts._ import com.knockdata.spark.highcharts.model._ import org.apache.spark.sql.SparkSession val spark
import com.knockdata.spark.highcharts._
import com.knockdata.spark.highcharts.model._
import org.apache.spark.sql.SparkSession
val spark = SparkSession
.builder()
.appName("Spark structured streaming Kafka example")
.master("yarn")
.getOrCreate()
val inputstream = spark.readStream
.format("kafka")
.option("kafka.bootstrap.servers", "n11.hdp.com:6667,n12.hdp.com:6667,n13.hdp.com:6667 ,n10.hdp.com:6667, n9.hdp.com:6667")
.option("subscribe", "st")
.load()
spark.conf.set("spark.sql.streaming.checkpointLocation", "checkpoint")
val ValueString = inputstream.selectExpr("CAST( value AS STRING)").as[(String)]
.select(
expr("(split(value, ','))[1]").cast("string").as("GSM"),
expr("(split(value, ','))[7]").cast("double").as("Duration"),
expr("(split(value, ','))[10]").cast("double").as("DataUpLink1"),
expr("(split(value, ','))[11]").cast("double").as("DataDownLink1")
)
.filter("GSM is not null and DataUpLink1 is not null and DataDownLink1 is not null and Duration is not null")
.groupBy("GSM").agg(sum("DataUpLink1") as "upload",sum("DataDownLink1") as "download", sum("Duration") as "duration")
val query = highcharts(
ValueString.seriesCol("GSM")
.series("y" -> "download","x" -> "duration")
.orderBy(col("GSM")), z, "complete")
query.processAllAvailable()
query.awaitTermination()
println("%angular")
StreamingChart(z)
我的(图表段落)代码是:
您的数据看起来如何?你能用它粘贴一个json吗?它的spark数据框,是的,我能