Apache spark “错误”;未知队列:root.default";当火花屈服于纱线时

Apache spark “错误”;未知队列:root.default";当火花屈服于纱线时,apache-spark,hadoop,pyspark,airflow,yarn,Apache Spark,Hadoop,Pyspark,Airflow,Yarn,我正在通过气流和SparkSubmitor操作器向一个新构建的纱线集群提交一个简单的Pyspark wordcount作业。作业命中了Thread,我可以在ResourceManager UI中看到它,但由于以下错误而失败: “诊断:应用程序应用程序由用户root提交到未知队列:root.default” 默认的.root队列似乎确实存在: *Application Queues Legend:CapacityUsedUsed (over capacity)Max Capacity

我正在通过气流和SparkSubmitor操作器向一个新构建的纱线集群提交一个简单的Pyspark wordcount作业。作业命中了Thread,我可以在ResourceManager UI中看到它,但由于以下错误而失败:

“诊断:应用程序应用程序由用户root提交到未知队列:root.default”

默认的.root队列似乎确实存在:

*Application Queues
  Legend:CapacityUsedUsed (over capacity)Max Capacity
      .root    0.0% used
          ..Queue: default    0.0% used


'default' Queue Status
Queue State:    RUNNING
Used Capacity:  0.0%
Configured Capacity:    100.0%
Configured Max Capacity:    100.0%
Absolute Used Capacity: 0.0%
Absolute Configured Capacity:   100.0%
Absolute Configured Max Capacity:   100.0%
Used Resources: <memory:0, vCores:0>
Num Schedulable Applications:   0
Num Non-Schedulable Applications:   0
Num Containers: 0
Max Applications:   10000
Max Applications Per User:  10000
Max Application Master Resources:   <memory:3072, vCores:1>
Used Application Master Resources:  <memory:0, vCores:0>
Max Application Master Resources Per User:  <memory:3072, vCores:1>
Configured Minimum User Limit Percent:  100%
Configured User Limit Factor:   1.0
Accessible Node Labels: *
Preemption: disabled*
*应用程序队列
图例:已使用容量(超容量)最大容量
.root已使用0.0%
..队列:默认使用0.0%
“默认”队列状态
队列状态:正在运行
使用容量:0.0%
配置容量:100.0%
配置的最大容量:100.0%
绝对使用容量:0.0%
绝对配置容量:100.0%
绝对配置最大容量:100.0%
使用的资源:
Num可调度应用程序:0
Num个不可调度的应用程序:0
容器数:0
最多申请人数:10000
每个用户最多应用程序数:10000
最大应用程序主资源:
已使用的应用程序主资源:
每个用户的最大应用程序主资源:
配置的最小用户限制百分比:100%
配置的用户限制系数:1.0
可访问的节点标签:*
抢占:禁用*

我错过了什么?谢谢

使用队列名称提交
默认值


资源管理器中的
根目录
仅用于以分层形式对队列进行分组。

有效,谢谢!奇怪的是,root.default被直接使用了
*Application Queues
  Legend:CapacityUsedUsed (over capacity)Max Capacity
      .root    0.0% used
          ..Queue: default    0.0% used


'default' Queue Status
Queue State:    RUNNING
Used Capacity:  0.0%
Configured Capacity:    100.0%
Configured Max Capacity:    100.0%
Absolute Used Capacity: 0.0%
Absolute Configured Capacity:   100.0%
Absolute Configured Max Capacity:   100.0%
Used Resources: <memory:0, vCores:0>
Num Schedulable Applications:   0
Num Non-Schedulable Applications:   0
Num Containers: 0
Max Applications:   10000
Max Applications Per User:  10000
Max Application Master Resources:   <memory:3072, vCores:1>
Used Application Master Resources:  <memory:0, vCores:0>
Max Application Master Resources Per User:  <memory:3072, vCores:1>
Configured Minimum User Limit Percent:  100%
Configured User Limit Factor:   1.0
Accessible Node Labels: *
Preemption: disabled*