Hadoop Hbase区域服务器无法与HMaster通信

Hadoop Hbase区域服务器无法与HMaster通信,hadoop,hbase,hive,apache-zookeeper,Hadoop,Hbase,Hive,Apache Zookeeper,我无法在分布式模式下设置hbase。当我在一台机器上设置它(独立模式)时,它工作正常。我的Zookeeper、hmaster和region服务器正常启动。 但当我转到hbase shell并查找状态时。它向我显示了0区域服务器。我正在附加我的区域服务器日志。加上我的主节点(namenode)和从节点(datanode)的主机文件。我已经尝试了stackoverflow上提供的每一个P&C来更改主机文件,但对我无效 2013-06-24 15:03:45,844 INFO org.a

我无法在分布式模式下设置hbase。当我在一台机器上设置它(独立模式)时,它工作正常。我的Zookeeper、hmaster和region服务器正常启动。
但当我转到hbase shell并查找状态时。它向我显示了0区域服务器。我正在附加我的区域服务器日志。加上我的主节点(namenode)和从节点(datanode)的主机文件。我已经尝试了stackoverflow上提供的每一个P&C来更改主机文件,但对我无效

       2013-06-24 15:03:45,844 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server naresh-pc/192.168.0.108:2181. Will not attempt to authenticate using SASL (unknown error)
            2013-06-24 15:03:45,845 WARN org.apache.zookeeper.ClientCnxn: Session 0x13f75807d960001 for server null, unexpected error, closing socket connection and attempting to reconnect

            java.net.ConnectException: Connection refused
                    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
                    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
                    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
                    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)

     Slave /etc/hosts :

    127.0.0.1       localhost
    127.0.1.1       ubuntu-pc
    #ip for hadoop
    192.168.0.108   master
    192.168.0.126   slave

    # The following lines are desirable for IPv6 capable hosts
    ::1     ip6-localhost ip6-loopback
    fe00::0 ip6-localnet
    ff00::0 ip6-mcastprefix
    ff02::1 ip6-allnodes
    ff02::2 ip6-allrouters

    Master /etc/hosts :

    127.0.0.1       localhost
    127.0.1.1       naresh-pc
   #ip for hadoop 
    192.168.0.108   master
    192.168.0.126   slave


    # The following lines are desirable for IPv6 capable hosts
    ::1     ip6-localhost ip6-loopback
    fe00::0 ip6-localnet
    ff00::0 ip6-mcastprefix
    ff02::1 ip6-allnodes
    ff02::2 ip6-allrouters
hbase-site.xml:

  <configuration>  
 <property>
    <name>hbase.master</name>
           <value>master:60000</value>
          <description>The host and port that the HBase master runs at.
                    A value of 'local' runs the master and a regionserver
                                                     in a single process.
                               </description>
                </property>

                <property>
                                <name>hbase.rootdir</name>
                                <value>hdfs://master:54310/hbase</value>
                                <description>The directory shared by region servers.</description>
                </property>


<property>
                                <name>hbase.cluster.distributed</name>
                                <value>true</value>
                                <description>The mode the cluster will be in. Possible values are
                                false: standalone and pseudo-distributed setups with managed
                                Zookeeper true: fully-distributed with unmanaged Zookeeper
                                Quorum (see hbase-env.sh)
                                </description>
                </property>
                <property>
                                <name>hbase.zookeeper.property.clientPort</name>
                                <value>2181</value>
                                <description>Property from ZooKeeper's config zoo.cfg.
                                The port at which the clients will connect.
                                </description>
                </property>

                <property>
           <name>hbase.zookeeper.quorum</name>
             <value>master</value>
                <description>Comma separated list of servers in the ZooKeeper Quorum.
                                     For example,
                                     "host1.mydomain.com,host2.mydomain.com".
                                     By default this is set to localhost for local and
                                     pseudo-distributed modes of operation. For a
                                     fully-distributed setup, this should be set to a full
                                     list of ZooKeeper quorum servers. If
                                     HBASE_MANAGES_ZK is set in hbase-env.sh
                                     this is the list of servers which we will start/stop
                                     ZooKeeper on.
                </description>
                </property>
</configuration>

    Zookeeper log:

         2013-06-28 18:22:26,781 WARN org.apache.zookeeper.server.NIOServerCnxn: caught end of stream exception
    EndOfStreamException: Unable to read additional data from client sessionid 0x13f8ac0b91b0002, likely client has closed socket
        at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
        at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
        at java.lang.Thread.run(Thread.java:722)
    2013-06-28 18:22:26,858 INFO org.apache.zookeeper.server.NIOServerCnxn: Closed socket connection for client /192.168.0.108:57447 which had sessionid 0x13f8ac0b91b0002
    2013-06-28 18:25:21,001 INFO org.apache.zookeeper.server.ZooKeeperServer: Expiring session 0x13f8ac0b91b0002, timeout of 180000ms exceeded
    2013-06-28 18:25:21,002 INFO org.apache.zookeeper.server.PrepRequestProcessor: Processed session termination for sessionid: 0x13f8ac0b91b0002      

Master Log:
2013-06-28 18:22:41,932 INFO org.apache.hadoop.hbase.master.ServerManager: Waiting for region servers count to settle; currently checked in 0, slept for 1502022 ms
2013-06-28 18:22:43,457 INFO org.apache.hadoop.hbase.master.ServerManager: Waiting for region servers count to settle; currently checked in 0, slept for 1503547 ms

hbase.master
船长:60000
HBase主机运行的主机和端口。
值“local”运行主服务器和regionserver
在一个过程中。
hbase.rootdir
hdfs://master:54310/hbase
区域服务器共享的目录。
hbase.cluster.distributed
真的
群集将处于的模式。可能的值是
false:独立和伪分布式设置,带有托管
Zookeeper true:与非托管Zookeeper一起完全分发
法定人数(见hbase env.sh)
hbase.zookeeper.property.clientPort
2181
来自ZooKeeper的config zoo.cfg的属性。
客户端将连接的端口。
hbase.zookeeper.quorum
主人
ZooKeeper仲裁中以逗号分隔的服务器列表。
例如
“host1.mydomain.com,host2.mydomain.com”。
默认情况下,对于本地和
伪分布式操作模式。暂时
完全分布式设置,此设置应设置为完全分布式
ZooKeeper仲裁服务器的列表。如果
HBASE__ZK在HBASE-env.sh中设置
这是我们将启动/停止的服务器列表
动物园管理员继续。
动物园管理员日志:
2013-06-28 18:22:26781警告org.apache.zookeeper.server.NIOServerCnxn:捕获到流结束异常
EndOfStreamException:无法从客户端会话ID 0x13f8ac0b91b0002读取其他数据,客户端可能已关闭套接字
位于org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
位于org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
运行(Thread.java:722)
2013-06-28 18:22:26858 INFO org.apache.zookeeper.server.NIOServerCnxn:client/192.168.0.108:57447的封闭套接字连接,其会话ID为0x13f8ac0b91b0002
2013-06-28 18:25:21001 INFO org.apache.zookeeper.server.ZooKeeperServer:正在过期的会话0x13f8ac0b91b0002,超过了180000毫秒的超时时间
2013-06-28 18:25:21002 INFO org.apache.zookeeper.server.prerequestProcessor:已处理会话ID的会话终止:0x13f8ac0b91b0002
主日志:
2013-06-28 18:22:41932 INFO org.apache.hadoop.hbase.master.ServerManager:等待区域服务器计数结算;当前签入0,睡眠1502022毫秒
2013-06-28 18:22:43457 INFO org.apache.hadoop.hbase.master.ServerManager:等待区域服务器计数结算;当前签入0,睡眠时间为1503547毫秒

从主机文件中删除127.0.1.1并启动IPV6。这应该可以解决问题。

您的区域服务器正在naresh pc上寻找HMaster,但您的/etc/hosts文件中没有任何此类条目。请确保您的配置正确。

您能尝试所有这些吗:

确保您的
/conf/regionserver
文件只有一个条目:

不确定您使用的是哪个HBase版本,但请使用端口
9000

主服务器和从服务器上的/etc/hosts文件应仅包含以下自定义条目:

127.0.0.1本地主机
192.168.0.108主机
192.168.0.126从机

我担心您的日志状态
正在打开与服务器naresh pc/192.168.0.108:2181的套接字连接

显然,系统认为zookeeper位于主机
naresh pc
,但在您的配置中,您正在主机
master
上设置zookeeper仲裁,HBase将绑定到该主机。这是个问题。根据我的经验,HBase对主机名非常挑剔,因此请确保它们在所有配置和/etc/hosts文件中都是同步的


此外,这可能是一个小问题,但在.xml文件中指定zookeper数据目录以具有使群集工作的最低设置集不会有任何影响:
hbase.zookeper.property.dataDir

我已经禁用了ipv6城域网。仔细看看我的配置。删除127.0.1.1不起作用我也有同样的问题,此主机配置文件解决了127.0.0.1本地主机127.0.0.1 dell-E6410的问题。因此,请为您建议的naresh pci更改添加127.0.0.1记录。但还是没有成功。为了方便您,谨附上日志2013-06-27 16:32:52464 INFO org.apache.hadoop.hbase.regionserver.HRegionServer:At