Apache spark 更改AWS EMR';s纱线调度程序向FIFO发出无效的资源请求
我通过将以下xml代码添加到/etc/hadoop/config/warn-site.xml中,更改了AWS EMR的纱线调度程序Apache spark 更改AWS EMR';s纱线调度程序向FIFO发出无效的资源请求,apache-spark,hadoop,yarn,amazon-emr,Apache Spark,Hadoop,Yarn,Amazon Emr,我通过将以下xml代码添加到/etc/hadoop/config/warn-site.xml中,更改了AWS EMR的纱线调度程序 <name>yarn.acl.enable</name> <value>true</value> </property> <property> <name>yarn.resourcemanager.scheduler.class</name> <value
<name>yarn.acl.enable</name>
<value>true</value>
</property>
<property>
<name>yarn.resourcemanager.scheduler.class</name>
<value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.fifo.FifoScheduler</value>
</property>
调度程序已成功切换到FIFO,如下图所示:
有人能解释一下这里的错误吗?你能添加fair-scheduler.xml吗?我正在尝试实现fifo调度器,那不是fifo-scheduler.xml吗?我在哪里能找到那个指南?
org.apache.hadoop.yarn.exceptions.InvalidLabelResourceRequestException: Invalid resource request, queue=default doesn't have permission to access all labels in resource request. labelExpression of resource request=CORE. Queue labels=
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerUtils.validateResourceRequest(SchedulerUtils.java:333)
at org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerUtils.normalizeAndValidateRequest(SchedulerUtils.java:257)
at ...