Apache spark Spark独立群集上的Spark身份验证和加密,Spark.master.rest.enabled=true
我们如何使用spark.master.rest.enabled=true在spark独立群集上进行身份验证和加密。 启用身份验证时主机上出现以下错误: 错误util.SparkUncaughtExceptionHandler:线程[main,5,main]中存在未捕获的异常Apache spark Spark独立群集上的Spark身份验证和加密,Spark.master.rest.enabled=true,apache-spark,Apache Spark,我们如何使用spark.master.rest.enabled=true在spark独立群集上进行身份验证和加密。 启用身份验证时主机上出现以下错误: 错误util.SparkUncaughtExceptionHandler:线程[main,5,main]中存在未捕获的异常 java.lang.IllegalArgumentException: requirement failed: The RestSubmissionServer does not support authentication
java.lang.IllegalArgumentException: requirement failed: The RestSubmissionServer does not support authentication via spark.authenticate.secret. Either turn off the RestSubmissionServer with =false, or do not use authentication.
at scala.Predef$.require(Predef.scala:224)
at org.apache.spark.deploy.master.Master.<init>(Master.scala:130)
at org.apache.spark.deploy.master.Master$.startRpcEnvAndEndpoint(Master.scala:1076)
at org.apache.spark.deploy.master.Master$.main(Master.scala:1058)
at org.apache.spark.deploy.master.Master.main(Master.scala)
java.lang.IllegalArgumentException:要求失败:RestSubmissionServer不支持通过spark.authenticate.secret进行身份验证。使用=false关闭RestSubmissionServer,或者不使用身份验证。
在scala.Predef$.require处(Predef.scala:224)
位于org.apache.spark.deploy.master.master(master.scala:130)
位于org.apache.spark.deploy.master.master$.startRpcEnvAndEndpoint(master.scala:1076)
位于org.apache.spark.deploy.master.master$.main(master.scala:1058)
位于org.apache.spark.deploy.master.master.main(master.scala)