Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181

Warning: file_get_contents(/data/phpspider/zhask/data//catemap/5/bash/15.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache spark 从配置单元运行spark作业时出错。-错误:java.lang.NoClassDefFoundError:org/apache/spark/SparkConf(状态=,代码=0)_Apache Spark_Hive_Hdfs - Fatal编程技术网

Apache spark 从配置单元运行spark作业时出错。-错误:java.lang.NoClassDefFoundError:org/apache/spark/SparkConf(状态=,代码=0)

Apache spark 从配置单元运行spark作业时出错。-错误:java.lang.NoClassDefFoundError:org/apache/spark/SparkConf(状态=,代码=0),apache-spark,hive,hdfs,Apache Spark,Hive,Hdfs,从配置单元CLI运行spark作业时出错 jdbc:hive2://hdpworker.kyvostest.com:10000>按id从样本组中选择id; 错误:java.lang.NoClassDefFoundError:org/apache/spark/SparkConf(状态=,代码=0) 从蜂巢里试过火花作业 蜂巢-1.2 spark-2.3 hdp 2.6.5 0:jdbc:hive2://hdpworker.kyvostest.com:10000>设置hive.execution.e

从配置单元CLI运行spark作业时出错

jdbc:hive2://hdpworker.kyvostest.com:10000>按id从样本组中选择id; 错误:java.lang.NoClassDefFoundError:org/apache/spark/SparkConf(状态=,代码=0)

从蜂巢里试过火花作业 蜂巢-1.2 spark-2.3 hdp 2.6.5

0:jdbc:hive2://hdpworker.kyvostest.com:10000>设置hive.execution.engine=spark; 没有受影响的行(0.069秒) 0:jdbc:hive2://hdpworker.kyvostest.com:10000>按id从样本组中选择id; 错误:java.lang.NoClassDefFoundError:org/apache/spark/SparkConf(状态=,代码=0) 0:jdbc:hive2://hdpworker.kyvostest.com:10000>


当使用mr引擎运行时,作业运行正常。

似乎配置单元未配置spark类路径。似乎配置单元未配置spark类路径。