Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/apache-spark/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache spark 更改配置设置后,如何在EMR中重新启动Spark服务?_Apache Spark_Emr_Amazon Emr - Fatal编程技术网

Apache spark 更改配置设置后,如何在EMR中重新启动Spark服务?

Apache spark 更改配置设置后,如何在EMR中重新启动Spark服务?,apache-spark,emr,amazon-emr,Apache Spark,Emr,Amazon Emr,我正在使用EMR-5.9.0,在更改一些配置文件后,我想重新启动服务以查看效果。我怎样才能做到这一点 我尝试使用initctl list查找服务的名称,正如我在其他答案中看到的那样,但没有成功…因为Spark作为Hadoop上的应用程序运行,所以您可以尝试 sudo stop hadoop-yarn-resourcemanager sudo start hadoop-yarn-resourcemanager 如果您指的是Spark历史服务器,那么您可以使用 sudo stop s

我正在使用EMR-5.9.0,在更改一些配置文件后,我想重新启动服务以查看效果。我怎样才能做到这一点


我尝试使用initctl list查找服务的名称,正如我在其他答案中看到的那样,但没有成功…

因为Spark作为Hadoop上的应用程序运行,所以您可以尝试

 sudo stop hadoop-yarn-resourcemanager  
 sudo start hadoop-yarn-resourcemanager  
如果您指的是Spark历史服务器,那么您可以使用

 sudo stop spark-history-server  
 sudo start spark-history-server  
检查服务的状态可以使用

sudo status hadoop-yarn-resourcemanager
sudo status spark-history-server
编辑:
正如所建议的,对于EMR的最新版本,请使用

sudo systemctl stop/start/status hadoop-yarn-resourcemanager

在5.x EMR集群中,您还可以执行以下操作:

[hadoop@ip-10-0-2-93 conf]$ initctl list | grep yarn
hadoop-yarn-timelineserver start/running, process 10632
hadoop-yarn-resourcemanager start/running, process 10771
hadoop-yarn-proxyserver start/running, process 10508

[hadoop@ip-10-0-2-93 conf]$ sudo stop hadoop-yarn-resourcemanager
hadoop-yarn-resourcemanager stop/waiting

[hadoop@ip-10-0-2-93 conf]$ sudo start hadoop-yarn-resourcemanager
hadoop-yarn-resourcemanager start/running, process 1591

[hadoop@ip-10-0-2-93 conf]$ initctl list | grep yarn
hadoop-yarn-timelineserver start/running, process 10632
hadoop-yarn-resourcemanager start/running, process 1591
hadoop-yarn-proxyserver start/running, process 10508

你找到了吗?当我尝试启动spark history server时,我遇到了与Hive相同的问题:我遇到了以下错误开始:作业无法启动任何想法?对于尝试最新EMR版本的用户,请将命令更改为
sudo systemctl stop hadoop warn resourcemanager