tez上的hive抛出“没有运行LLAP守护进程”错误

tez上的hive抛出“没有运行LLAP守护进程”错误,hive,tez,Hive,Tez,我有一个LLAP服务在Amazon EMR的纱线集群上运行。 这是显示llap服务已打开的图像,其名称为llap_服务: 我已经将hive.llap.daemon.service.hosts设置为@llap\u服务, 但是我在hive中的查询无法成功,日志如下: 2018-01-08 08:22:43,866 [INFO] [LlapScheduler] |tezplugins.LlapTaskSchedulerService|: Timeout monitor task not started

我有一个LLAP服务在Amazon EMR的纱线集群上运行。 这是显示llap服务已打开的图像,其名称为llap_服务:

我已经将hive.llap.daemon.service.hosts设置为@llap\u服务, 但是我在hive中的查询无法成功,日志如下:

2018-01-08 08:22:43,866 [INFO] [LlapScheduler] |tezplugins.LlapTaskSchedulerService|: Timeout monitor task not started. Timeout future state: false, #instances: 0
2018-01-08 08:22:43,866 [INFO] [TaskSchedulerEventHandlerThread] |tezplugins.LlapTaskSchedulerService|: PendingTasksInfo=numPriorityLevels=5. [p=38,c=2][p=41,c=2][p=44,c=1][p=50,c=2][p=89,c=22]. totalPendingTasks=29. delayedTaskQueueSize=0
2018-01-08 08:22:43,866 [INFO] [LlapScheduler] |tezplugins.LlapTaskSchedulerService|: Inadequate total resources before scheduling pending tasks. Signalling scheduler timeout monitor thread to start timer.
2018-01-08 08:22:43,866 [INFO] [TaskSchedulerEventHandlerThread] |tezplugins.LlapTaskSchedulerService|: Received allocateRequest. task=attempt_1515129349345_0057_1_08_000022_0, priority=89, capability=<memory:2048, vCores:1>, hosts=null
2018-01-08 08:22:43,866 [INFO] [LlapScheduler] |tezplugins.LlapTaskSchedulerService|: Timeout monitor task not started. Timeout future state: false, #instances: 0
2018-01-08 08:22:43,866 [INFO] [TaskSchedulerEventHandlerThread] |tezplugins.LlapTaskSchedulerService|: PendingTasksInfo=numPriorityLevels=5. [p=38,c=2][p=41,c=2][p=44,c=1][p=50,c=2][p=89,c=23]. totalPendingTasks=30. delayedTaskQueueSize=0
2018-01-08 08:22:43,866 [INFO] [LlapScheduler] |tezplugins.LlapTaskSchedulerService|: Inadequate total resources before scheduling pending tasks. Signalling scheduler timeout monitor thread to start timer.
2018-01-08 08:22:43,867 [INFO] [LlapScheduler] |tezplugins.LlapTaskSchedulerService|: Timeout monitor task not started. Timeout future state: false, #instances: 0
2018-01-08 08:22:50,987 [INFO] [LlapTaskSchedulerTimedLogThread] |tezplugins.LlapTaskSchedulerService|: Stats for current dag: NumPreemptedTasks=0, NumRequestedAllocations=30, NumRequestsWithlocation=4, NumLocalAllocations=0,NumNonLocalAllocations=0,NumTotalAllocations=0,NumRequestsWithoutLocation=26, NumRejectedTasks=0, NumCommFailures=0, NumDelayedAllocations=2, LocalityBasedAllocationsPerHost={}, NumAllocationsPerHost={}
2018-01-08 08:23:31,081 [INFO] [AMRM Callback Handler Thread] |rm.YarnTaskSchedulerService|: Allocated: <memory:0, vCores:0> Free: <memory:6477824, vCores:1> pendingRequests: 0 delayedContainers: 0 heartbeats: 51 lastPreemptionHeartbeat: 50
2018-01-08 08:23:42,334 [INFO] [LlapTaskSchedulerTimeoutMonitor] |tezplugins.LlapTaskSchedulerService$SchedulerTimeoutMonitor|: Reporting SERVICE_UNAVAILABLE error as no instances are running
2018-01-08 08:23:42,336 [WARN] [TaskSchedulerAppCallbackExecutor #0] |tez.Utils|: Error reported by TaskScheduler [[2:LLAP]][SERVICE_UNAVAILABLE] No LLAP Daemons are running, Failing dag: [SELECT d_placement.name  AS `d_placem...DESC(Stage-1), dag_1515129349345_0057_1]

在没有LLAP的情况下,tez的蜂巢工作得很好,有人能告诉我哪里错了吗?非常感谢。

您需要从日志中找出LLAP恶魔无法启动的原因。从RM UI>Slider llap应用程序>容器日志中,您可能会看到如下内容

LLAP服务承载以“@”启动的服务,但未设置hive.zookeeper.quorum。必须设置hive.zookeeper.quorum。您需要在hive-site.xml中添加以下属性

<property>
    <name>hive.zookeeper.quorum</name>
    <value><hostname1>:2181,<hostname2>:2181,[...]</value>
</property>
并重新生成滑块llap纱线应用程序

这帮了大忙