Warning: file_get_contents(/data/phpspider/zhask/data//catemap/7/kubernetes/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181

Warning: file_get_contents(/data/phpspider/zhask/data//catemap/2/ssis/2.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Kubernetes kuberenetes上的火花流失败_Kubernetes_Apache Spark Sql_Spark Streaming - Fatal编程技术网

Kubernetes kuberenetes上的火花流失败

Kubernetes kuberenetes上的火花流失败,kubernetes,apache-spark-sql,spark-streaming,Kubernetes,Apache Spark Sql,Spark Streaming,我正在使用一个自定义接收器从外部资源中提取数据,我不确定是什么原因导致在运行了几个小时后在kuberenetes上运行Spark streaming作业时出现此异常 我在Spark 2.4.5上 有调试提示吗 org.apache.spark.SparkException:无法添加数据,因为BlockGenerator尚未启动或已停止 位于org.apache.spark.streaming.receiver.BlockGenerator.addData(BlockGenerator.scala

我正在使用一个自定义接收器从外部资源中提取数据,我不确定是什么原因导致在运行了几个小时后在kuberenetes上运行Spark streaming作业时出现此异常

我在Spark 2.4.5上

有调试提示吗

org.apache.spark.SparkException:无法添加数据,因为BlockGenerator尚未启动或已停止 位于org.apache.spark.streaming.receiver.BlockGenerator.addData(BlockGenerator.scala:173) 在org.apache.spark.streaming.receiver.ReceiverSupervisorImpl.pushSingle(ReceiverSupervisorImpl.scala:120)上 位于org.apache.spark.streaming.receiver.receiver.store(receiver.scala:119)