Apache spark 更改配置设置后,如何在EMR中重新启动Spark服务?
我正在使用EMR-5.9.0,在更改一些配置文件后,我想重新启动服务以查看效果。我怎样才能做到这一点Apache spark 更改配置设置后,如何在EMR中重新启动Spark服务?,apache-spark,emr,amazon-emr,Apache Spark,Emr,Amazon Emr,我正在使用EMR-5.9.0,在更改一些配置文件后,我想重新启动服务以查看效果。我怎样才能做到这一点 我尝试使用initctl list查找服务的名称,正如我在其他答案中看到的那样,但没有成功…因为Spark作为Hadoop上的应用程序运行,所以您可以尝试 sudo stop hadoop-yarn-resourcemanager sudo start hadoop-yarn-resourcemanager 如果您指的是Spark历史服务器,那么您可以使用 sudo stop s
我尝试使用initctl list查找服务的名称,正如我在其他答案中看到的那样,但没有成功…因为Spark作为Hadoop上的应用程序运行,所以您可以尝试
sudo stop hadoop-yarn-resourcemanager
sudo start hadoop-yarn-resourcemanager
如果您指的是Spark历史服务器,那么您可以使用
sudo stop spark-history-server
sudo start spark-history-server
检查服务的状态可以使用
sudo status hadoop-yarn-resourcemanager
sudo status spark-history-server
编辑:正如所建议的,对于EMR的最新版本,请使用
sudo systemctl stop/start/status hadoop-yarn-resourcemanager
在5.x EMR集群中,您还可以执行以下操作:
[hadoop@ip-10-0-2-93 conf]$ initctl list | grep yarn
hadoop-yarn-timelineserver start/running, process 10632
hadoop-yarn-resourcemanager start/running, process 10771
hadoop-yarn-proxyserver start/running, process 10508
[hadoop@ip-10-0-2-93 conf]$ sudo stop hadoop-yarn-resourcemanager
hadoop-yarn-resourcemanager stop/waiting
[hadoop@ip-10-0-2-93 conf]$ sudo start hadoop-yarn-resourcemanager
hadoop-yarn-resourcemanager start/running, process 1591
[hadoop@ip-10-0-2-93 conf]$ initctl list | grep yarn
hadoop-yarn-timelineserver start/running, process 10632
hadoop-yarn-resourcemanager start/running, process 1591
hadoop-yarn-proxyserver start/running, process 10508
你找到了吗?当我尝试启动spark history server时,我遇到了与Hive相同的问题:我遇到了以下错误开始:作业无法启动任何想法?对于尝试最新EMR版本的用户,请将命令更改为
sudo systemctl stop hadoop warn resourcemanager