Apache storm Apache Storm 2.1.0-拓扑工作程序无法在120000毫秒内启动
我在ApacheStorm 2.1.0中运行了40种拓扑结构,其中有两个监控节点和一个nimbus。某些拓扑在运行数小时后往往会停止。在Storm UI中,拓扑状态显示为active,而Num workers变为0。在supervisor.log中,我可以多次尝试启动工作进程,但每次启动都会超时。有人能帮我解决这个工人启动超时和工人到期问题吗 Storm UI-拓扑摘要Apache storm Apache Storm 2.1.0-拓扑工作程序无法在120000毫秒内启动,apache-storm,Apache Storm,我在ApacheStorm 2.1.0中运行了40种拓扑结构,其中有两个监控节点和一个nimbus。某些拓扑在运行数小时后往往会停止。在Storm UI中,拓扑状态显示为active,而Num workers变为0。在supervisor.log中,我可以多次尝试启动工作进程,但每次启动都会超时。有人能帮我解决这个工人启动超时和工人到期问题吗 Storm UI-拓扑摘要 Name Id Owner Status Uptime Num workers Num executors
Name Id Owner Status Uptime Num workers Num executors Num tasks Replication count Assigned Mem (MB) Scheduler Info Topology Version Storm Version
cg42 cg42-921-1598918471 storm ACTIVE 11h 56m 28s 0 34 34 1 340 2.1.0
supervisor.log
2020-09-01 16:41:47.104 o.a.s.d.s.BasicContainer SLOT_7702 [INFO] Created Worker ID 08a00105-e9c0-4659-a1bf-3cf61f82cedb
2020-09-01 16:41:47.104 o.a.s.d.s.Container SLOT_7702 [INFO] Setting up 98ae2de0-558e-4681-9b14-7e539d33339a-10.10.11.28:08a00105-e9c0-4659-a1bf-3cf61f82cedb
2020-09-01 16:41:47.104 o.a.s.d.s.Container SLOT_7702 [INFO] GET worker-user for 08a00105-e9c0-4659-a1bf-3cf61f82cedb
2020-09-01 16:41:47.105 o.a.s.d.s.Container SLOT_7702 [INFO] SET worker-user 08a00105-e9c0-4659-a1bf-3cf61f82cedb storm
2020-09-01 16:41:47.105 o.a.s.d.s.Container SLOT_7702 [DEBUG] Creating symlinks for worker-id: 08a00105-e9c0-4659-a1bf-3cf61f82cedb topology-id: cg42-921-1598918471 to its port artifacts directory
2020-09-01 16:41:47.105 o.a.s.d.s.AdvancedFSOps SLOT_7702 [DEBUG] Creating symlink [/data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/artifacts] to [/var/log/apps/storm2x/workers-artifacts/cg42]
2020-09-01 16:41:47.105 o.a.s.d.s.Container SLOT_7702 [INFO] Creating symlinks for worker-id: 08a00105-e9c0-4659-a1bf-3cf61f82cedb storm-id: cg42-921-1598918471 for files(1): [resources]
2020-09-01 16:41:47.105 o.a.s.d.s.AdvancedFSOps SLOT_7702 [DEBUG] Creating symlink [/data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/resources] to [/data1/stormlocaldir2x/supervisor/stormdist/]
2020-09-01 16:41:47.105 o.a.s.d.s.BasicContainer SLOT_7702 [INFO] Launching worker with assignment LocalAssignment(topology_id:cg42-921-1598918471, executors:[ExecutorInfo(task_start:30, task_end:30), ExecutorIn
2020-09-01 16:41:47.106 o.a.s.d.s.BasicContainer SLOT_7702 [INFO] Launching worker with command: 'java' '-cp' '/opt/apache-storm-2.1.0/lib-worker/*:/opt/apache-storm-2.1.0/extlib/*:/opt/apache-storm-2.1.0/conf:/
2020-09-01 16:41:47.107 o.a.s.d.s.Slot SLOT_7702 [INFO] STATE waiting-for-blob-localization msInState: 6 -> waiting-for-worker-start msInState: 0 topo:cg42-921-1598918471 worker:08a00105-e9c0-4659-a1bf-3cf61f82c
2020-09-01 16:41:47.108 o.a.s.u.LocalState SLOT_7702 [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:41:47.555 o.a.s.u.LocalState timer [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:41:48.109 o.a.s.d.s.Slot SLOT_7702 [INFO] STATE waiting-for-worker-start msInState: 1002 topo:cg42-921-1598918471 worker:08a00105-e9c0-4659-a1bf-3cf61f82cedb -> waiting-for-worker-start msInState:
2020-09-01 16:43:23.134 o.a.s.u.LocalState SLOT_7702 [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:24.016 o.a.s.u.LocalState timer [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:24.134 o.a.s.d.s.Slot SLOT_7702 [INFO] STATE waiting-for-worker-start msInState: 97027 topo:cg42-921-1598918471 worker:08a00105-e9c0-4659-a1bf-3cf61f82cedb -> waiting-for-worker-start msInState:
2020-09-01 16:43:24.134 o.a.s.u.LocalState SLOT_7702 [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:25.041 o.a.s.u.LocalState timer [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:25.134 o.a.s.d.s.Slot SLOT_7702 [INFO] STATE waiting-for-worker-start msInState: 98027 topo:cg42-921-1598918471 worker:08a00105-e9c0-4659-a1bf-3cf61f82cedb -> waiting-for-worker-start msInState:
2020-09-01 16:43:25.134 o.a.s.u.LocalState SLOT_7702 [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:26.066 o.a.s.u.LocalState timer [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:26.135 o.a.s.d.s.Slot SLOT_7702 [INFO] STATE waiting-for-worker-start msInState: 99028 topo:cg42-921-1598918471 worker:08a00105-e9c0-4659-a1bf-3cf61f82cedb -> waiting-for-worker-start msInState:
2020-09-01 16:43:26.135 o.a.s.u.LocalState SLOT_7702 [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:27.092 o.a.s.u.LocalState timer [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:27.135 o.a.s.d.s.Slot SLOT_7702 [INFO] STATE waiting-for-worker-start msInState: 100028 topo:cg42-921-1598918471 worker:08a00105-e9c0-4659-a1bf-3cf61f82cedb -> waiting-for-worker-start msInState
2020-09-01 16:43:44.138 o.a.s.u.LocalState SLOT_7702 [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:44.524 o.a.s.u.LocalState timer [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:45.138 o.a.s.d.s.Slot SLOT_7702 [INFO] STATE waiting-for-worker-start msInState: 118031 topo:cg42-921-1598918471 worker:08a00105-e9c0-4659-a1bf-3cf61f82cedb -> waiting-for-worker-start msInState
2020-09-01 16:43:45.138 o.a.s.u.LocalState SLOT_7702 [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:45.549 o.a.s.u.LocalState timer [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:46.139 o.a.s.d.s.Slot SLOT_7702 [INFO] STATE waiting-for-worker-start msInState: 119032 topo:cg42-921-1598918471 worker:08a00105-e9c0-4659-a1bf-3cf61f82cedb -> waiting-for-worker-start msInState
2020-09-01 16:43:46.139 o.a.s.u.LocalState SLOT_7702 [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:46.573 o.a.s.u.LocalState timer [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:47.139 o.a.s.d.s.Slot SLOT_7702 [INFO] STATE waiting-for-worker-start msInState: 120032 topo:cg42-921-1598918471 worker:08a00105-e9c0-4659-a1bf-3cf61f82cedb -> waiting-for-worker-start msInState
2020-09-01 16:43:47.139 o.a.s.u.LocalState SLOT_7702 [DEBUG] New Local State for /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:47.139 o.a.s.d.s.Slot SLOT_7702 [WARN] SLOT 7702: Container topo:cg42-921-1598918471 worker:08a00105-e9c0-4659-a1bf-3cf61f82cedb failed to launch in 120000 ms.
2020-09-01 16:43:47.139 o.a.s.d.s.Slot SLOT_7702 [INFO] STATE waiting-for-worker-start msInState: 120032 topo:cg42-921-1598918471 worker:08a00105-e9c0-4659-a1bf-3cf61f82cedb -> kill-and-relaunch msInState: 0 top
2020-09-01 16:43:47.139 o.a.s.d.s.Container SLOT_7702 [INFO] Cleaning up 98ae2de0-558e-4681-9b14-7e539d33339a-10.10.11.28:08a00105-e9c0-4659-a1bf-3cf61f82cedb
2020-09-01 16:43:47.139 o.a.s.d.s.Container SLOT_7702 [INFO] GET worker-user for 08a00105-e9c0-4659-a1bf-3cf61f82cedb
2020-09-01 16:43:47.139 o.a.s.d.s.AdvancedFSOps SLOT_7702 [INFO] Deleting path /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/heartbeats
2020-09-01 16:43:47.140 o.a.s.d.s.AdvancedFSOps SLOT_7702 [INFO] Deleting path /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/pids
2020-09-01 16:43:47.140 o.a.s.d.s.AdvancedFSOps SLOT_7702 [INFO] Deleting path /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb/tmp
2020-09-01 16:43:47.140 o.a.s.d.s.AdvancedFSOps SLOT_7702 [INFO] Deleting path /data1/stormlocaldir2x/workers/08a00105-e9c0-4659-a1bf-3cf61f82cedb
2020-09-01 16:43:47.140 o.a.s.d.s.Container SLOT_7702 [INFO] REMOVE worker-user 08a00105-e9c0-4659-a1bf-3cf61f82cedb
2020-09-01 16:43:47.140 o.a.s.d.s.AdvancedFSOps SLOT_7702 [INFO] Deleting path /data1/stormlocaldir2x/workers-users/08a00105-e9c0-4659-a1bf-3cf61f82cedb
2020-09-01 16:43:47.141 o.a.s.d.s.BasicContainer SLOT_7702 [INFO] Removed Worker ID 08a00105-e9c0-4659-a1bf-3cf61f82cedb