n、 运行查询(SQLOperation.java:255) 位于org.apache.hive.service.cli.operation.SQLOperation.access$800(SQLOperation.java:91) 位于org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:348) 位于java.security.AccessController.doPrivileged(本机方法) 位于javax.security.auth.Subject.doAs(Subject.java:415) 位于org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692) 位于org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:362) 位于java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) 在java.util.concurrent.FutureTask.run(FutureTask.java:262)处 位于java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 位于java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 运行(Thread.java:745) 原因:java.net.SocketTimeoutException:callTimeout=60000,callDuration=68449:区域=hbase:meta,1.1588230740,主机名=iZuf6istfz0***,474281521453094275,seqNum=0,表'hbase:meta'上的行'hiveExternalTable',00000000000000000000' 位于org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159) 位于org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:64) ... 3个以上 原因:org.apache.hadoop.hbase.exceptions.ConnectionClosingException:在本地调用iZuf6istfz0***/120.55.X.X:47428失败,但ion:org.apache.hadoop.hbase.exceptions.ConnectionClosingException:连接iZuf6istfz0***/120.55.X:47428失败结束。呼叫id=9,等待时间=2 位于org.apache.hadoop.hbase.ipc.RpcClientImpl.wrapException(RpcClientImpl.java:1239) 位于org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1210) 位于org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:213) 位于org.apache.hadoop.hbase.ipc.AbstractRpcClient$blockingRpcChannel实现.callBlockingMethod(AbstractRpcClient.java:287) 位于org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32651) 位于org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:372) 位于org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:199) 位于org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:62) 位于org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200) 位于org.apache.hadoop.hbase.client.scannercallablewithreplications$retryngrpc.call(scannercallablewithreplications.java:369) 位于org.apache.hadoop.hbase.client.scannercallablewithreplications$retryngrpc.call(scannercallablewithreplications.java:343) 位于org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126) ... 4更多 原因:org.apache.hadoop.hbase.exceptions.ConnectionClosingException:iZuf6istfz0***/120.55.X.X:47428的连接正在关闭。呼叫id=9,等待时间=2 位于org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.cleanupCalls(RpcClientImpl.java:1037) 位于org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.close(RpcClientImpl.java:844) 位于org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.run(RpcClientImpl.java:572) 作业提交失败,出现异常“org.apache.hadoop.hbase.client.RetrieseHaustedException”(尝试次数=36次后失败,异常: 2018年3月20日星期二10:42:23 CST,null,java.net.SocketTimeoutException:callTimeout=60000,callDuration=68449:region=hbase:meta,1.1588230740,hostname=iZuf6istfz0***,474281521453094275,seqNum=0,表'hbase:meta'上的行'logRequestRecord',00000000000000000000' )' 失败:执行错误,从org.apache.hadoop.hive.ql.exec.mr.MapRedTask返回代码1。尝试次数=36次后失败,异常: 2018年3月20日星期二10:42:23 CST,null,java.net.SocketTimeoutException:callTimeout=60000,callDuration=68449:region=hbase:meta,1.1588230740,hostname=iZuf6istfz0***,474281521453094275,seqNum=0,表'hbase:meta'上的行'logRequestRecord',00000000000000000000'

n、 运行查询(SQLOperation.java:255) 位于org.apache.hive.service.cli.operation.SQLOperation.access$800(SQLOperation.java:91) 位于org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:348) 位于java.security.AccessController.doPrivileged(本机方法) 位于javax.security.auth.Subject.doAs(Subject.java:415) 位于org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1692) 位于org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:362) 位于java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) 在java.util.concurrent.FutureTask.run(FutureTask.java:262)处 位于java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 位于java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 运行(Thread.java:745) 原因:java.net.SocketTimeoutException:callTimeout=60000,callDuration=68449:区域=hbase:meta,1.1588230740,主机名=iZuf6istfz0***,474281521453094275,seqNum=0,表'hbase:meta'上的行'hiveExternalTable',00000000000000000000' 位于org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159) 位于org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:64) ... 3个以上 原因:org.apache.hadoop.hbase.exceptions.ConnectionClosingException:在本地调用iZuf6istfz0***/120.55.X.X:47428失败,但ion:org.apache.hadoop.hbase.exceptions.ConnectionClosingException:连接iZuf6istfz0***/120.55.X:47428失败结束。呼叫id=9,等待时间=2 位于org.apache.hadoop.hbase.ipc.RpcClientImpl.wrapException(RpcClientImpl.java:1239) 位于org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1210) 位于org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:213) 位于org.apache.hadoop.hbase.ipc.AbstractRpcClient$blockingRpcChannel实现.callBlockingMethod(AbstractRpcClient.java:287) 位于org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32651) 位于org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:372) 位于org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:199) 位于org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:62) 位于org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200) 位于org.apache.hadoop.hbase.client.scannercallablewithreplications$retryngrpc.call(scannercallablewithreplications.java:369) 位于org.apache.hadoop.hbase.client.scannercallablewithreplications$retryngrpc.call(scannercallablewithreplications.java:343) 位于org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126) ... 4更多 原因:org.apache.hadoop.hbase.exceptions.ConnectionClosingException:iZuf6istfz0***/120.55.X.X:47428的连接正在关闭。呼叫id=9,等待时间=2 位于org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.cleanupCalls(RpcClientImpl.java:1037) 位于org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.close(RpcClientImpl.java:844) 位于org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.run(RpcClientImpl.java:572) 作业提交失败,出现异常“org.apache.hadoop.hbase.client.RetrieseHaustedException”(尝试次数=36次后失败,异常: 2018年3月20日星期二10:42:23 CST,null,java.net.SocketTimeoutException:callTimeout=60000,callDuration=68449:region=hbase:meta,1.1588230740,hostname=iZuf6istfz0***,474281521453094275,seqNum=0,表'hbase:meta'上的行'logRequestRecord',00000000000000000000' )' 失败:执行错误,从org.apache.hadoop.hive.ql.exec.mr.MapRedTask返回代码1。尝试次数=36次后失败,异常: 2018年3月20日星期二10:42:23 CST,null,java.net.SocketTimeoutException:callTimeout=60000,callDuration=68449:region=hbase:meta,1.1588230740,hostname=iZuf6istfz0***,474281521453094275,seqNum=0,表'hbase:meta'上的行'logRequestRecord',00000000000000000000',hadoop,jdbc,hive,hbase,Hadoop,Jdbc,Hive,Hbase,hive-site.xml: ....... <property> <name>hive.metastore.schema.verification</name> <value>false</value> </property> <property> <name>javax.jdo.option.ConnectionURL</name> <value

hive-site.xml:

 .......
 <property>
   <name>hive.metastore.schema.verification</name>
   <value>false</value>
 </property>

 <property>
   <name>javax.jdo.option.ConnectionURL</name>
   <value>jdbc:mysql://localhost:3306/hivemetastore?useUnicode=true&characterEncoding=utf-8&allowMultiQueries=true</value>
 </property>

 <property>
   <name>javax.jdo.option.ConnectionDriverName</name>
   <value>com.mysql.jdbc.Driver</value>
 </property>

 <property>
   <name>javax.jdo.option.ConnectionUserName</name>
   <value>dongpinyun</value>
 </property>
 <property>
   <name>javax.jdo.option.ConnectionPassword</name>
   <value>dongpinyun@hk2016</value>
 </property>

 <property>
 <name>hive.exec.mode.local.auto</name>
 <value>true</value>
 </property>

  <property>
    <name>hbase.zookeeper.quorum</name>
    <value>iZuf6is************</value>
  </property>

  <property>
    <name>hbase.zookeeper.property.clientPort</name>
    <value>2182</value>
  </property>

  <property>
    <name>hive.optimize.cp</name>
    <value>true</value>
  </property>

  <property>
    <name>hive.optimize.pruner</name>
    <value>true</value>
  </property>

  <property>
    <name>hive.zookeeper.quorum</name>
    <value>iZuf6is************</value>
  </property>

  <property>
    <name>hive.zookeeper.client.port</name>
    <value>2181</value>
  </property>
  .......
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
    <property>
        <name>hbase.rootdir</name>
        <value>hdfs://iZuf6i****:9000/hbase</value>
    </property>
    <property>
        <name>hbase.cluster.distributed</name>
        <value>false</value>
    </property>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
    <property>
        <name>hbase.zookeeper.quorum</name>
        <value>iZuf6i****:2182</value>
    </property>
    <property>
        <name>hbase.zookeeper.property.clientPort</name>
        <value>2182</value>
    </property>
    <property>
        <name>hbase.zookeeper.property.maxClientCnxns</name>
        <value>50</value>
    </property>
    <property>
        <name>hbase.regionserver.handler.count</name>
        <value>50</value>
    </property>
</configuration>
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
    <property>
        <name>hadoop.tmp.dir</name>
        <value>/mnt/hadoop/hadoop-2.6.5/tmp</value>
    </property>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://iZuf6i******:9000</value>
    </property>
    <property>
        <name>hadoop.proxyuser.root.hosts</name>
        <value>*</value>
    </property>
    <property>
        <name>hadoop.proxyuser.root.groups</name>
        <value>*</value>
    </property>
</configuration>
。。。。。。。
hive.metastore.schema.verification
假的
javax.jdo.option.ConnectionURL
jdbc:mysql://localhost:3306/hivemetastore?useUnicode=true&characterEncoding=utf-8&allowMultiQueries=true
javax.jdo.option.ConnectionDriverName
com.mysql.jdbc.Driver
javax.jdo.option.ConnectionUserName
董品云
javax.jdo.option.ConnectionPassword
dongpinyun@hk2016
hive.exec.mode.local.auto
真的
hbase.zookeeper.quorum
iZuf6is************
hbase.zookeeper.property.clientPort
2182
hive.optimize.cp
真的
蜂巢修剪器
真的
蜂箱、动物园管理员、法定人数
iZuf6is************
hive.zookeeper.client.port
2181
.......
hbase-site.xml:

 .......
 <property>
   <name>hive.metastore.schema.verification</name>
   <value>false</value>
 </property>

 <property>
   <name>javax.jdo.option.ConnectionURL</name>
   <value>jdbc:mysql://localhost:3306/hivemetastore?useUnicode=true&characterEncoding=utf-8&allowMultiQueries=true</value>
 </property>

 <property>
   <name>javax.jdo.option.ConnectionDriverName</name>
   <value>com.mysql.jdbc.Driver</value>
 </property>

 <property>
   <name>javax.jdo.option.ConnectionUserName</name>
   <value>dongpinyun</value>
 </property>
 <property>
   <name>javax.jdo.option.ConnectionPassword</name>
   <value>dongpinyun@hk2016</value>
 </property>

 <property>
 <name>hive.exec.mode.local.auto</name>
 <value>true</value>
 </property>

  <property>
    <name>hbase.zookeeper.quorum</name>
    <value>iZuf6is************</value>
  </property>

  <property>
    <name>hbase.zookeeper.property.clientPort</name>
    <value>2182</value>
  </property>

  <property>
    <name>hive.optimize.cp</name>
    <value>true</value>
  </property>

  <property>
    <name>hive.optimize.pruner</name>
    <value>true</value>
  </property>

  <property>
    <name>hive.zookeeper.quorum</name>
    <value>iZuf6is************</value>
  </property>

  <property>
    <name>hive.zookeeper.client.port</name>
    <value>2181</value>
  </property>
  .......
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
    <property>
        <name>hbase.rootdir</name>
        <value>hdfs://iZuf6i****:9000/hbase</value>
    </property>
    <property>
        <name>hbase.cluster.distributed</name>
        <value>false</value>
    </property>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
    <property>
        <name>hbase.zookeeper.quorum</name>
        <value>iZuf6i****:2182</value>
    </property>
    <property>
        <name>hbase.zookeeper.property.clientPort</name>
        <value>2182</value>
    </property>
    <property>
        <name>hbase.zookeeper.property.maxClientCnxns</name>
        <value>50</value>
    </property>
    <property>
        <name>hbase.regionserver.handler.count</name>
        <value>50</value>
    </property>
</configuration>
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
    <property>
        <name>hadoop.tmp.dir</name>
        <value>/mnt/hadoop/hadoop-2.6.5/tmp</value>
    </property>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://iZuf6i******:9000</value>
    </property>
    <property>
        <name>hadoop.proxyuser.root.hosts</name>
        <value>*</value>
    </property>
    <property>
        <name>hadoop.proxyuser.root.groups</name>
        <value>*</value>
    </property>
</configuration>

hbase.rootdir
hdfs://iZuf6i****:9000/hbase
hbase.cluster.distributed
假的
dfs.replication
1.
hbase.zookeeper.quorum
iZuf6i****:2182
hbase.zookeeper.property.clientPort
2182
hbase.zookeeper.property.maxClientCnxns
50
hbase.regionserver.handler.count