Warning: file_get_contents(/data/phpspider/zhask/data//catemap/5/date/2.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache spark 队列未占用全部资源_Apache Spark_Hadoop_Yarn - Fatal编程技术网

Apache spark 队列未占用全部资源

Apache spark 队列未占用全部资源,apache-spark,hadoop,yarn,Apache Spark,Hadoop,Yarn,我的群集有2个队列: 默认值-50%,不能上升。 重要-50%,可以超过50。 请参见下面的我的配置: <configuration> <property><name>yarn.scheduler.capacity.root.queues</name><value>default,important</value></property> <property><name>yarn.sched

我的群集有2个队列:
默认值
-50%,不能上升。
重要
-50%,可以超过50。
请参见下面的我的配置:

<configuration>
<property><name>yarn.scheduler.capacity.root.queues</name><value>default,important</value></property>
<property><name>yarn.scheduler.capacity.root.capacity</name><value>100</value></property>
<property><name>yarn.scheduler.capacity.root.default.capacity</name><value>50</value>
<property><name>yarn.scheduler.capacity.root.important.capacity</name><value>50</value>
<property><name>yarn.scheduler.capacity.root.default.maximum-capacity</name><value>50</value>
<property><name>yarn.scheduler.capacity.resource-calculator</name><value>org.apache.hadoop.yarn.util.resource.DominantResourceCalculator</value>
<property><name>yarn.scheduler.capacity.root.support.user-limit-factor</name><value>2</value>
</configuration>

Thread.scheduler.capacity.root.queuesdefault,重要提示
纱线.scheduler.capacity.root.capacity100
warn.scheduler.capacity.root.default.capacity50
纱线.scheduler.capacity.root.important.capacity 50
纱线.scheduler.capacity.root.default.maximum-capacity 50
Thread.scheduler.capacity.resource-Calculator org.apache.hadoop.Thread.util.resource.DominantResourceCalculator
纱线.调度程序.容量.根.支持.用户限制系数2

问题是运行single spark应用程序时,
重要的
队列无法超出其专用容量(尤其是vcores)

能否显示Thread UI屏幕截图?它是什么分布(如Cloudera、EMR等)?@san它是Cloudera分布