Warning: file_get_contents(/data/phpspider/zhask/data//catemap/1/amazon-web-services/13.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Amazon web services elasticsearch:EC2发现:主节点工作数据节点失败_Amazon Web Services_<img Src="//i.stack.imgur.com/RUiNP.png" Height="16" Width="18" Alt="" Class="sponsor Tag Img">elasticsearch_Amazon Ec2 - Fatal编程技术网 elasticsearch,amazon-ec2,Amazon Web Services,elasticsearch,Amazon Ec2" /> elasticsearch,amazon-ec2,Amazon Web Services,elasticsearch,Amazon Ec2" />

Amazon web services elasticsearch:EC2发现:主节点工作数据节点失败

Amazon web services elasticsearch:EC2发现:主节点工作数据节点失败,amazon-web-services,elasticsearch,amazon-ec2,Amazon Web Services,elasticsearch,Amazon Ec2,我的目标是在EC2中的三个实例上运行一个6节点集群。 我在每个实例上放置一个仅主节点和一个仅数据节点(使用elastic ansible playbook) 三个实例中的每个主节点都使用EC2发现功能找到彼此,并形成一个由三个节点组成的集群,然后选择一个主节点。 来自相同实例的数据节点在启动时失败,错误如下 我试过什么 -通过主机名将数据节点切换到显式zen.unicast发现有效 -我可以从实例A->B在端口9301上远程登录,而不会出现问题 参考资料: java版本-OpenJDK运行时环境

我的目标是在EC2中的三个实例上运行一个6节点集群。 我在每个实例上放置一个仅主节点和一个仅数据节点(使用elastic ansible playbook)

三个实例中的每个主节点都使用EC2发现功能找到彼此,并形成一个由三个节点组成的集群,然后选择一个主节点。 来自相同实例的数据节点在启动时失败,错误如下

我试过什么
-通过主机名将数据节点切换到显式zen.unicast发现有效
-我可以从实例A->B在端口9301上远程登录,而不会出现问题

参考资料:
java版本-OpenJDK运行时环境(IcedTea 2.5.6)(7u79-2.5.6-0ubuntu1.14.04.1) es版本-2.1.0

数据节点elasticseach.yml

bootstrap.mlockall: false
cloud.aws.region: us-east
cluster.name: my-cluster
discovery.ec2.groups: stage-elasticsearch
discovery.ec2.host_type: private_dns
discovery.ec2.ping_timeout: 30s
discovery.type: ec2
discovery.zen.minimum_master_nodes: 2
discovery.zen.ping.multicast.enabled: false
gateway.expected_nodes: 4
http.port: 9201
network.host: _ec2:privateDns_
node.data: true
node.master: false
transport.tcp.port: 9301
node.name: ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1
主节点elasticsearch.yml

bootstrap.mlockall: false
cloud.aws.region: us-east
cluster.name: my-cluster
discovery.ec2.groups: stage-elasticsearch
discovery.ec2.host_type: private_dns
discovery.ec2.ping_timeout: 30s
discovery.type: ec2
discovery.zen.minimum_master_nodes: 2
discovery.zen.ping.multicast.enabled: false
gateway.expected_nodes: 4
http.port: 9200
network.host: _ec2:privateDns_
node.data: false 
node.master: true 
transport.tcp.port: 9300
node.name: ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-master
数据节点启动时出错:

[2016-03-02 15:45:06,246][INFO ][node                     ] [ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1] initializing ...
[2016-03-02 15:45:06,679][INFO ][plugins                  ] [ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1] loaded [cloud-aws], sites [head]
[2016-03-02 15:45:06,710][INFO ][env                      ] [ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1] using [1] data paths, mounts [[/ (/dev/xvda1)]], net usable_space [11.5gb], net total_space [14.6gb], spins? [no], types [ext4]
[2016-03-02 15:45:09,597][INFO ][node                     ] [ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1] initialized
[2016-03-02 15:45:09,597][INFO ][node                     ] [ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1] starting ...
[2016-03-02 15:45:09,678][INFO ][transport                ] [ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1] publish_address {ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1/xxx-xxx-xx-xxx:9301}, bound_addresses {xxx-xxx-xx-xxx:9301}
[2016-03-02 15:45:09,687][INFO ][discovery                ] [ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1] my-cluster/PNI6WAmzSYGgZcX2HsqenA
[2016-03-02 15:45:09,701][WARN ][com.amazonaws.jmx.SdkMBeanRegistrySupport]
java.security.AccessControlException: access denied ("javax.management.MBeanServerPermission" "findMBeanServer")
    at java.security.AccessControlContext.checkPermission(AccessControlContext.java:372)
    at java.security.AccessController.checkPermission(AccessController.java:559)
    at java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
    at javax.management.MBeanServerFactory.checkPermission(MBeanServerFactory.java:413)
    at javax.management.MBeanServerFactory.findMBeanServer(MBeanServerFactory.java:361)
    at com.amazonaws.jmx.MBeans.getMBeanServer(MBeans.java:111)
    at com.amazonaws.jmx.MBeans.registerMBean(MBeans.java:50)
    at com.amazonaws.jmx.SdkMBeanRegistrySupport.registerMetricAdminMBean(SdkMBeanRegistrySupport.java:27)
    at com.amazonaws.metrics.AwsSdkMetrics.registerMetricAdminMBean(AwsSdkMetrics.java:355)
    at com.amazonaws.metrics.AwsSdkMetrics.<clinit>(AwsSdkMetrics.java:316)
    at com.amazonaws.AmazonWebServiceClient.requestMetricCollector(AmazonWebServiceClient.java:563)
    at com.amazonaws.AmazonWebServiceClient.isRMCEnabledAtClientOrSdkLevel(AmazonWebServiceClient.java:504)
    at com.amazonaws.AmazonWebServiceClient.isRequestMetricsEnabled(AmazonWebServiceClient.java:496)
    at com.amazonaws.AmazonWebServiceClient.createExecutionContext(AmazonWebServiceClient.java:457)
    at com.amazonaws.services.ec2.AmazonEC2Client.describeInstances(AmazonEC2Client.java:5924)
    at org.elasticsearch.discovery.ec2.AwsEc2UnicastHostsProvider.fetchDynamicNodes(AwsEc2UnicastHostsProvider.java:118)
    at org.elasticsearch.discovery.ec2.AwsEc2UnicastHostsProvider$DiscoNodesCache.refresh(AwsEc2UnicastHostsProvider.java:230)
    at org.elasticsearch.discovery.ec2.AwsEc2UnicastHostsProvider$DiscoNodesCache.refresh(AwsEc2UnicastHostsProvider.java:215)
    at org.elasticsearch.common.util.SingleObjectCache.getOrRefresh(SingleObjectCache.java:55)
    at org.elasticsearch.discovery.ec2.AwsEc2UnicastHostsProvider.buildDynamicNodes(AwsEc2UnicastHostsProvider.java:104)
    at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing.sendPings(UnicastZenPing.java:335)
    at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing.ping(UnicastZenPing.java:240)
    at org.elasticsearch.discovery.zen.ping.ZenPingService.ping(ZenPingService.java:106)
    at org.elasticsearch.discovery.zen.ping.ZenPingService.pingAndWait(ZenPingService.java:84)
    at org.elasticsearch.discovery.zen.ZenDiscovery.findMaster(ZenDiscovery.java:879)
    at org.elasticsearch.discovery.zen.ZenDiscovery.innerJoinCluster(ZenDiscovery.java:335)
    at org.elasticsearch.discovery.zen.ZenDiscovery.access$5000(ZenDiscovery.java:75)
    at org.elasticsearch.discovery.zen.ZenDiscovery$JoinThreadControl$1.run(ZenDiscovery.java:1236)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)
[2016-03-02 15:45:09,703][WARN ][com.amazonaws.metrics.AwsSdkMetrics]
java.security.AccessControlException: access denied ("javax.management.MBeanServerPermission" "findMBeanServer")
    at java.security.AccessControlContext.checkPermission(AccessControlContext.java:372)
    at java.security.AccessController.checkPermission(AccessController.java:559)
    at java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
    at javax.management.MBeanServerFactory.checkPermission(MBeanServerFactory.java:413)
    at javax.management.MBeanServerFactory.findMBeanServer(MBeanServerFactory.java:361)
    at com.amazonaws.jmx.MBeans.getMBeanServer(MBeans.java:111)
    at com.amazonaws.jmx.MBeans.isRegistered(MBeans.java:98)
    at com.amazonaws.jmx.SdkMBeanRegistrySupport.isMBeanRegistered(SdkMBeanRegistrySupport.java:46)
    at com.amazonaws.metrics.AwsSdkMetrics.registerMetricAdminMBean(AwsSdkMetrics.java:361)
    at com.amazonaws.metrics.AwsSdkMetrics.<clinit>(AwsSdkMetrics.java:316)
    at com.amazonaws.AmazonWebServiceClient.requestMetricCollector(AmazonWebServiceClient.java:563)
    at com.amazonaws.AmazonWebServiceClient.isRMCEnabledAtClientOrSdkLevel(AmazonWebServiceClient.java:504)
    at com.amazonaws.AmazonWebServiceClient.isRequestMetricsEnabled(AmazonWebServiceClient.java:496)
    at com.amazonaws.AmazonWebServiceClient.createExecutionContext(AmazonWebServiceClient.java:457)
    at com.amazonaws.services.ec2.AmazonEC2Client.describeInstances(AmazonEC2Client.java:5924)
    at org.elasticsearch.discovery.ec2.AwsEc2UnicastHostsProvider.fetchDynamicNodes(AwsEc2UnicastHostsProvider.java:118)
    at org.elasticsearch.discovery.ec2.AwsEc2UnicastHostsProvider$DiscoNodesCache.refresh(AwsEc2UnicastHostsProvider.java:230)
    at org.elasticsearch.discovery.ec2.AwsEc2UnicastHostsProvider$DiscoNodesCache.refresh(AwsEc2UnicastHostsProvider.java:215)
    at org.elasticsearch.common.util.SingleObjectCache.getOrRefresh(SingleObjectCache.java:55)
    at org.elasticsearch.discovery.ec2.AwsEc2UnicastHostsProvider.buildDynamicNodes(AwsEc2UnicastHostsProvider.java:104)
    at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing.sendPings(UnicastZenPing.java:335)
    at org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing.ping(UnicastZenPing.java:240)
    at org.elasticsearch.discovery.zen.ping.ZenPingService.ping(ZenPingService.java:106)
    at org.elasticsearch.discovery.zen.ping.ZenPingService.pingAndWait(ZenPingService.java:84)
    at org.elasticsearch.discovery.zen.ZenDiscovery.findMaster(ZenDiscovery.java:879)
    at org.elasticsearch.discovery.zen.ZenDiscovery.innerJoinCluster(ZenDiscovery.java:335)
    at org.elasticsearch.discovery.zen.ZenDiscovery.access$5000(ZenDiscovery.java:75)
    at org.elasticsearch.discovery.zen.ZenDiscovery$JoinThreadControl$1.run(ZenDiscovery.java:1236)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)
[2016-03-02 15:45:39,688][WARN ][discovery                ] [ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1] waited for 30s and no initial state was set by the discovery
[2016-03-02 15:45:39,698][INFO ][http                     ] [ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1] publish_address {ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1/xxx-xxx-xx-xxx:9201}, bound_addresses {xxx-xxx-xx-xxx:9201}
[2016-03-02 15:45:39,699][INFO ][node                     ] [ip-xxx-xxx-xx-xxx.vpc.fakedomain.com-data1] started
[2016-03-02 15:45:06246][INFO][node][ip xxx xxx xxx xxx.vpc.fakedomain.com-data1]正在初始化。。。
[2016-03-02 15:45:06679][INFO][plugins][ip xxx xxx xxx xxx.vpc.fakedomain.com-data1]已加载[cloud aws],站点[head]
[2016-03-02 15:45:06710][INFO][env][ip xxx xxx xxx xxx.vpc.fakedomain.com-data1]使用[1]数据路径,挂载[/(/dev/xvda1)],净可用空间[11.5gb],净总空间[14.6gb],自旋?[no],类型[ext4]
[2016-03-02 15:45:09597][INFO][node][ip xxx xxx xxx xxx.vpc.fakedomain.com-data1]已初始化
[2016-03-02 15:45:09597][INFO][node][ip xxx xxx xxx xxx.vpc.fakedomain.com-data1]正在启动。。。
[2016-03-02 15:45:09678][INFO][transport][ip xxx xxx xxx xxx.vpc.fakedomain.com-data1]发布地址{ip xxx xxx xxx xxx.vpc.fakedomain.com-data1/xxx xxx xxx xxx xxx xxx:9301},绑定地址{xxx xxx xxx xxx xxx xxx xxx xxx xxx xxx:9301}
[2016-03-02 15:45:09687][INFO][discovery][ip xxx xxx xxx xxx.vpc.fakedomain.com-data1]my cluster/PNI6WAmzSYGgZcX2HsqenA
[2016-03-02 15:45:09701][WARN][com.amazonaws.jmx.SdkMBeanRegistrySupport]
java.security.AccessControlException:拒绝访问(“javax.management.MBeanServerPermission”“findMBeanServer”)
位于java.security.AccessControlContext.checkPermission(AccessControlContext.java:372)
在java.security.AccessController.checkPermission(AccessController.java:559)
位于java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
位于javax.management.MBeanServerFactory.checkPermission(MBeanServerFactory.java:413)
位于javax.management.MBeanServerFactory.findMBeanServer(MBeanServerFactory.java:361)
位于com.amazonaws.jmx.MBeans.getMBeanServer(MBeans.java:111)
位于com.amazonaws.jmx.MBeans.registerMBean(MBeans.java:50)
位于com.amazonaws.jmx.SdkMBeanRegistrySupport.RegisterMetricAdminBean(SdkMBeanRegistrySupport.java:27)
在com.amazonaws.metrics.AwsSdkMetrics.RegisterMetricAdminBean(AwsSdkMetrics.java:355)
在com.amazonaws.metrics.AwsSdkMetrics.(AwsSdkMetrics.java:316)
位于com.amazonaws.AmazonWebServiceClient.requestMetricCollector(AmazonWebServiceClient.java:563)
位于com.amazonaws.AmazonWebServiceClient.isrmceEnabledAtClientorsdkLevel(AmazonWebServiceClient.java:504)
位于com.amazonaws.AmazonWebServiceClient.isRequestMetricsEnabled(AmazonWebServiceClient.java:496)
位于com.amazonaws.AmazonWebServiceClient.createExecutionContext(AmazonWebServiceClient.java:457)
位于com.amazonaws.services.ec2.AmazonEC2Client.descripbeinstances(AmazonEC2Client.java:5924)
在org.elasticsearch.discovery.ec2.awsec2unicashostsprovider.fetchDynamicNodes(awsec2unicashostsprovider.java:118)
位于org.elasticsearch.discovery.ec2.awsec2unicashostsprovider$discoodecache.refresh(awsec2unicashostsprovider.java:230)
位于org.elasticsearch.discovery.ec2.awsec2unicashostsprovider$discoodecache.refresh(awsec2unicashostsprovider.java:215)
位于org.elasticsearch.common.util.SingleObjectCache.getOrRefresh(SingleObjectCache.java:55)
位于org.elasticsearch.discovery.ec2.awsec2unicashostsprovider.builddynamicodes(awsec2unicashostsprovider.java:104)
位于org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing.sendPings(UnicastZenPing.java:335)
位于org.elasticsearch.discovery.zen.ping.unicast.UnicastZenPing.ping(UnicastZenPing.java:240)
位于org.elasticsearch.discovery.zen.ping.ZenPingService.ping(ZenPingService.java:106)
在org.elasticsearch.discovery.zen.ping.ZenPingService.pingAndWait(ZenPingService.java:84)上
位于org.elasticsearch.discovery.zen.zendescovery.findMaster(zendescovery.java:879)
位于org.elasticsearch.discovery.zen.ZenDiscovery.innerJoinCluster(ZenDiscovery.java:335)
在org.elasticsearch.discovery.zen.ZenDiscovery.access$5000(ZenDiscovery.java:75)
位于org.elasticsearch.discovery.zen.ZenDiscovery$JoinThreadControl$1.run(ZenDiscovery.java:1236)
位于java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
位于java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
运行(Thread.java:745)
[2016-03-02 15:45:09703][WARN][com.amazonaws.metrics.AwsSdkMetrics]
java.security.AccessControlException:拒绝访问(“javax.management.MBeanServerPermission”“findMBeanServer”)
位于java.security.AccessControlContext.checkPermission(AccessControlContext.java:372)
在java.security.AccessController.checkPermission(AccessController.java:559)
位于java.lang.SecurityManager.checkPermission(SecurityManager.java:549)
位于javax.management.MBeanServerFactory.checkPermission(MBeanServerFactory.java:413)
位于javax.management.MBeanServerFactory.findMBeanServer(MBeanServerFactory.java:361)
位于com.amazonaws.jmx.MBeans.getMBeanServer(MBeans.java:111)
com.amazonaws.jmx.MBeans.isRegistered(MBeans.java:98)
位于com.amazonaws.jmx.SdkMBeanRegistrySupport.isMBeanRegistered(SdkMBeanRegistrySupport.java:46)
在com.amazonaws.metrics.AwsSdkMetrics.RegisterMetricAdminBean(AwsSdkMetrics
# aws will try to do some sketchy JMX stuff, but its not needed.
com.amazonaws.jmx.SdkMBeanRegistrySupport: ERROR
com.amazonaws.metrics.AwsSdkMetrics: ERROR