Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/5.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
在没有hadoop的情况下安装spark时,主线程java.lang.ExceptionInInitializeError中出现异常_Java_Apache Spark_Java 10 - Fatal编程技术网

在没有hadoop的情况下安装spark时,主线程java.lang.ExceptionInInitializeError中出现异常

在没有hadoop的情况下安装spark时,主线程java.lang.ExceptionInInitializeError中出现异常,java,apache-spark,java-10,Java,Apache Spark,Java 10,我正在尝试安装spark2.3.0,更具体地说,它是spark-2.3.0-bin-hadoppo2.7 “D:\spark\bin”已添加到环境变量路径中。 同时,安装了JDK-10。 没有安装Hadoop。但谷歌表示,spark可以在没有hadoop的情况下工作 这是错误消息 C:\Users\a>spark-shell Exception in thread "main" java.lang.ExceptionInInitializerError at org.apache.

我正在尝试安装spark2.3.0,更具体地说,它是spark-2.3.0-bin-hadoppo2.7

“D:\spark\bin”已添加到环境变量路径中。 同时,安装了JDK-10。 没有安装Hadoop。但谷歌表示,spark可以在没有hadoop的情况下工作

这是错误消息

C:\Users\a>spark-shell
Exception in thread "main" java.lang.ExceptionInInitializerError
    at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:80)
    at org.apache.hadoop.security.SecurityUtil.getAuthenticationMethod(SecurityUtil.java:611)
    at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:273)
    at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:261)
    at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:791)
    at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:761)
    at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:634)
    at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2464)
    at org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2464)
    at scala.Option.getOrElse(Option.scala:121)
    at org.apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2464)
    at org.apache.spark.SecurityManager.<init>(SecurityManager.scala:222)
    at org.apache.spark.deploy.SparkSubmit$.secMgr$lzycompute$1(SparkSubmit.scala:393)
    at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$secMgr$1(SparkSubmit.scala:393)
    at org.apache.spark.deploy.SparkSubmit$$anonfun$prepareSubmitEnvironment$7.apply(SparkSubmit.scala:401)
    at org.apache.spark.deploy.SparkSubmit$$anonfun$prepareSubmitEnvironment$7.apply(SparkSubmit.scala:401)
    at scala.Option.map(Option.scala:146)
    at org.apache.spark.deploy.SparkSubmit$.prepareSubmitEnvironment(SparkSubmit.scala:400)
    at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:170)
    at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:136)
    at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.StringIndexOutOfBoundsException: begin 0, end 3, length 2
    at java.base/java.lang.String.checkBoundsBeginEnd(Unknown Source)
    at java.base/java.lang.String.substring(Unknown Source)
    at org.apache.hadoop.util.Shell.<clinit>(Shell.java:52)
    ... 21 more
C:\Users\a>sparkshell
线程“main”java.lang.ExceptionInInitializeError中出现异常
位于org.apache.hadoop.util.StringUtils。(StringUtils.java:80)
位于org.apache.hadoop.security.SecurityUtil.getAuthenticationMethod(SecurityUtil.java:611)
位于org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:273)
位于org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:261)
位于org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:791)
位于org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:761)
位于org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:634)
位于org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2464)
位于org.apache.spark.util.Utils$$anonfun$getCurrentUserName$1.apply(Utils.scala:2464)
位于scala.Option.getOrElse(Option.scala:121)
位于org.apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2464)
位于org.apache.spark.SecurityManager(SecurityManager.scala:222)
位于org.apache.spark.deploy.SparkSubmit$.secMgr$lzycompute$1(SparkSubmit.scala:393)
位于org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$secMgr$1(SparkSubmit.scala:393)
位于org.apache.spark.deploy.SparkSubmit$$anonfun$prepareSubmitEnvironment$7.apply(SparkSubmit.scala:401)
位于org.apache.spark.deploy.SparkSubmit$$anonfun$prepareSubmitEnvironment$7.apply(SparkSubmit.scala:401)
在scala.Option.map处(Option.scala:146)
位于org.apache.spark.deploy.SparkSubmit$.prepareSubmitEnvironment(SparkSubmit.scala:400)
位于org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:170)
位于org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:136)
位于org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
原因:java.lang.StringIndexOutOfBoundsException:开始0,结束3,长度2
位于java.base/java.lang.String.checkBoundsBeginEnd(未知源)
位于java.base/java.lang.String.substring(未知源)
位于org.apache.hadoop.util.Shell(Shell.java:52)
... 还有21个

有人知道我应该如何安装spark吗?

当前的spark版本(2.3)不支持JDK 9或10。最新支持的JDK版本是JDK 8。您应该降级您的Java安装。

您好,请使用jdk 1.8版本,它的稳定性也请告诉我们您是尝试安装spark并通过spark shell使用它,还是在IDE中使用它说eclipseRelated我使用的是openjdk版本“1.8.0Þ”和spark-2.4.3-bin-hadoop2.7,仍然面临这个问题。请帮帮我。