Phoenix对hbase数据的查询超时异常

Phoenix对hbase数据的查询超时异常,hbase,timeoutexception,phoenix,Hbase,Timeoutexception,Phoenix,我在hbase中有一个表(比如T1),我在该表上运行了T1中的select count(*),其中包含 超过6000万行。但它给出了以下超时异常错误。我不能更改Phoenix的超时参数吗 com.salesforce.phoenix.exception.PhoenixIOException: com.salesforce.phoenix.exception.PhoenixIOException: 136520ms passed since the last invocation, timeout

我在hbase中有一个表(比如T1),我在该表上运行了T1中的select count(*),其中包含 超过6000万行。但它给出了以下超时异常错误。我不能更改Phoenix的超时参数吗

com.salesforce.phoenix.exception.PhoenixIOException: com.salesforce.phoenix.exception.PhoenixIOException: 136520ms passed since the last invocation, timeout is currently set to 60000
    at com.salesforce.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:107)
    at com.salesforce.phoenix.iterate.ParallelIterators.getIterators(ParallelIterators.java:217)
    at com.salesforce.phoenix.iterate.ConcatResultIterator.getIterators(ConcatResultIterator.java:54)
    at com.salesforce.phoenix.iterate.ConcatResultIterator.currentIterator(ConcatResultIterator.java:76)
    at com.salesforce.phoenix.iterate.ConcatResultIterator.next(ConcatResultIterator.java:96)
    at com.salesforce.phoenix.iterate.GroupedAggregatingResultIterator.next(GroupedAggregatingResultIterator.java:78)
    at com.salesforce.phoenix.iterate.UngroupedAggregatingResultIterator.next(UngroupedAggregatingResultIterator.java:49)
    at com.salesforce.phoenix.jdbc.PhoenixResultSet.next(PhoenixResultSet.java:741)
    at com.salesforce.phoenix.jdbc.PhoenixConnection.executeStatements(PhoenixConnection.java:113)
    at com.salesforce.phoenix.util.PhoenixRuntime.executeStatements(PhoenixRuntime.java:260)
    at com.salesforce.phoenix.util.PhoenixRuntime.main(PhoenixRuntime.java:207)
Caused by: java.util.concurrent.ExecutionException: com.salesforce.phoenix.exception.PhoenixIOException: 136520ms passed since the last invocation, timeout is currently set to 60000
    at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:262)
    at java.util.concurrent.FutureTask.get(FutureTask.java:119)
    at com.salesforce.phoenix.iterate.ParallelIterators.getIterators(ParallelIterators.java:211)
    ... 9 more
Caused by: com.salesforce.phoenix.exception.PhoenixIOException: 136520ms passed since the last invocation, timeout is currently set to 60000
    at com.salesforce.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:107)
    at com.salesforce.phoenix.iterate.ScanningResultIterator.next(ScanningResultIterator.java:62)
    at com.salesforce.phoenix.iterate.TableResultIterator.next(TableResultIterator.java:86)
    at com.salesforce.phoenix.iterate.SpoolingResultIterator.<init>(SpoolingResultIterator.java:110)
    at com.salesforce.phoenix.iterate.SpoolingResultIterator.<init>(SpoolingResultIterator.java:75)
    at com.salesforce.phoenix.iterate.SpoolingResultIterator$SpoolingResultIteratorFactory.newIterator(SpoolingResultIterator.java:69)
    at com.salesforce.phoenix.iterate.ParallelIterators$2.call(ParallelIterators.java:184)
    at com.salesforce.phoenix.iterate.ParallelIterators$2.call(ParallelIterators.java:174)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:679)
Caused by: org.apache.hadoop.hbase.client.ScannerTimeoutException: 136520ms passed since the last invocation, timeout is currently set to 60000
    at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:283)
    at com.salesforce.phoenix.iterate.ScanningResultIterator.next(ScanningResultIterator.java:57)
    ... 11 more
Caused by: org.apache.hadoop.hbase.UnknownScannerException: org.apache.hadoop.hbase.UnknownScannerException: Name: -3353955827223074008
    at org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2590)
    at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:616)
    at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:320)
    at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)

    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:532)
    at org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:96)
    at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:149)
    at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:42)
    at org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:163)
    at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:274)
    ... 12 more
com.salesforce.phoenix.exception.phoenix异常:com.salesforce.phoenix.exception.phoenix异常:自上次调用以来已传递136520ms,超时当前设置为60000
位于com.salesforce.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:107)
位于com.salesforce.phoenix.iterate.ParallelIterators.getIterators(ParallelIterators.java:217)
位于com.salesforce.phoenix.iterate.concatresulterator.getIterators(concatresulterator.java:54)
位于com.salesforce.phoenix.iterate.concatresulterator.currentIterator(concatresulterator.java:76)
位于com.salesforce.phoenix.iterate.concatresulterator.next(concatresulterator.java:96)
位于com.salesforce.phoenix.iterate.GroupedAggregatingResultIterator.next(GroupedAggregatingResultIterator.java:78)
位于com.salesforce.phoenix.iterate.UngroupedAggregatingResultIterator.next(UngroupedAggregatingResultIterator.java:49)
位于com.salesforce.phoenix.jdbc.PhoenixResultSet.next(PhoenixResultSet.java:741)
位于com.salesforce.phoenix.jdbc.PhoenixConnection.executeStatements(PhoenixConnection.java:113)
位于com.salesforce.phoenix.util.PhoenixRuntime.executeStatements(PhoenixRuntime.java:260)
位于com.salesforce.phoenix.util.PhoenixRuntime.main(PhoenixRuntime.java:207)
原因:java.util.concurrent.ExecutionException:com.salesforce.phoenix.exception.phoenix异常:自上次调用以来已传递136520ms,超时当前设置为60000
位于java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:262)
位于java.util.concurrent.FutureTask.get(FutureTask.java:119)
位于com.salesforce.phoenix.iterate.ParallelIterators.getIterators(ParallelIterators.java:211)
... 9更多
原因:com.salesforce.phoenix.exception.phoenix异常:自上次调用以来已传递136520ms,超时当前设置为60000
位于com.salesforce.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:107)
位于com.salesforce.phoenix.iterate.ScanningResultIterator.next(ScanningResultIterator.java:62)
位于com.salesforce.phoenix.iterate.TableResultIterator.next(TableResultIterator.java:86)
位于com.salesforce.phoenix.iterate.spoolingrulterator.(spoolingrulterator.java:110)
位于com.salesforce.phoenix.iterate.spoolingrulterator.(spoolingrulterator.java:75)
位于com.salesforce.phoenix.iterate.spoolingrulterator$spoolingrulteratorfactory.newIterator(spoolingrulterator.java:69)
在com.salesforce.phoenix.iterate.ParallelIterators$2.call上(ParallelIterators.java:184)
在com.salesforce.phoenix.iterate.ParallelIterators$2.call上(ParallelIterators.java:174)
位于java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
在java.util.concurrent.FutureTask.run(FutureTask.java:166)中
位于java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
位于java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
运行(Thread.java:679)
原因:org.apache.hadoop.hbase.client.ScannerTimeoutException:自上次调用以来已传递136520ms,超时当前设置为60000
位于org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:283)
位于com.salesforce.phoenix.iterate.ScanningResultIterator.next(ScanningResultIterator.java:57)
... 还有11个
原因:org.apache.hadoop.hbase.UnknownScannerException:org.apache.hadoop.hbase.UnknownScannerException:Name:-335395582722230740008
位于org.apache.hadoop.hbase.regionserver.HRegionServer.next(HRegionServer.java:2590)
位于sun.reflect.GeneratedMethodAccessor20.invoke(未知源)
在sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)中
位于java.lang.reflect.Method.invoke(Method.java:616)
位于org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:320)
位于org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)
位于sun.reflect.NativeConstructorAccessorImpl.newInstance0(本机方法)
位于sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
在sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
位于java.lang.reflect.Constructor.newInstance(Constructor.java:532)
位于org.apache.hadoop.hbase.RemoteExceptionHandler.decodeRemoteException(RemoteExceptionHandler.java:96)
位于org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:149)
位于org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:42)
位于org.apache.hadoop.hbase.client.ServerCallable.withRetries(ServerCallable.java:163)
位于org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:274)
... 还有12个

尝试在hbase-site.xml中将phoenix.query.timeoutMs修改为更高的值。默认为10分钟


请参阅:

在hbase服务器站点上尝试更改
hbase.regionserver.lease.period
hbase.client.scanner.timeout.period

我在运行读取我的表的Spark应用程序(约5000万行)时遇到相同的异常。我正在使用HDP2.4和Ambari。在HBase设置中,我可以启用Phoenix并设置查询超时值,但这似乎没有任何效果,即使在重新启动集群之后。。。有人能帮忙吗?