Hive 无法在配置单元上创建InputInitializerManager错误-TEZ
我已经安装了Apache Tez 0.8.1、Hadoop版本2.7.0和Hive版本2.01。我能够成功地运行Map Reduce作业。但是当我配置Hive并尝试运行一个简单的计数查询时，它返回了以下错误。从它试图查找jar的错误中，我将jar放在类路径中，但错误仍然没有解决 请帮我解决这个问题。提前谢谢Hive 无法在配置单元上创建InputInitializerManager错误-TEZ,hive,hadoop2,apache-tez,bigdata,Hive,Hadoop2,Apache Tez,Bigdata,我已经安装了Apache Tez 0.8.1、Hadoop版本2.7.0和Hive版本2.01。我能够成功地运行Map Reduce作业。但是当我配置Hive并尝试运行一个简单的计数查询时，它返回了以下错误。从它试图查找jar的错误中，我将jar放在类路径中，但错误仍然没有解决 请帮我解决这个问题。提前谢谢 hive> select count(*) from sample1; Query ID = root_20160728215555_a58e91a6-8913-4a5
hive> select count(*) from sample1;
Query ID = root_20160728215555_a58e91a6-8913-4a57-8715-bc1739a2cb02
Total jobs = 1
Launching Job 1 out of 1
----------------------------------------------------------------------------------------------
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING FAILED KILLED
----------------------------------------------------------------------------------------------
Map 1 container FAILED -1 0 0 -1 0 0
Reducer 2 container KILLED 1 0 0 1 0 0
----------------------------------------------------------------------------------------------
VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 0.17 s
----------------------------------------------------------------------------------------------
Status: Failed
Vertex failed, vertexName=Map 1, vertexId=vertex_1469720608711_0011_1_00, diagnostics=[Vertex vertex_1469720608711_0011_1_00 [Map 1] killed/failed due to:INIT_FAILURE, Fail to create InputInitializerManager, org.apache.tez.dag.api.TezReflectionException: Unable to instantiate class with 1 arguments: org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator
at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:70)
at org.apache.tez.common.ReflectionUtils.createClazzInstance(ReflectionUtils.java:89)
at org.apache.tez.dag.app.dag.RootInputInitializerManager.createInitializer(RootInputInitializerManager.java:138)
at org.apache.tez.dag.app.dag.RootInputInitializerManager.runInputInitializers(RootInputInitializerManager.java:115)
at org.apache.tez.dag.app.dag.impl.VertexImpl.setupInputInitializerManager(VertexImpl.java:4676)
at org.apache.tez.dag.app.dag.impl.VertexImpl.access$4300(VertexImpl.java:204)
at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.handleInitEvent(VertexImpl.java:3445)
at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:3394)
at org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition(VertexImpl.java:3375)
at org.apache.hadoop.yarn.state.StateMachineFactory$MultipleInternalArc.doTransition(StateMachineFactory.java:385)
at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:302)
at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1975)
at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:203)
at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2090)
at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:2076)
at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at org.apache.tez.common.ReflectionUtils.getNewInstance(ReflectionUtils.java:68)
... 20 more
Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/split/SplitLocationProvider
at org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.<init>(HiveSplitGenerator.java:96)
... 25 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.split.SplitLocationProvider
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 26 more
]
Vertex killed, vertexName=Reducer 2, vertexId=vertex_1469720608711_0011_1_01, diagnostics=[Vertex received Kill in NEW state., Vertex vertex_1469720608711_0011_1_01 [Reducer 2] killed/failed due to:OTHER_VERTEX_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1
hive>从sample1中选择count（*）；
查询ID=root_20160728215555_a58e91a6-8913-4a57-8715-bc1739a2cb02
职位总数=1
正在启动作业1/1
----------------------------------------------------------------------------------------------
顶点模式状态总计已完成运行挂起失败已终止
----------------------------------------------------------------------------------------------
映射1容器失败-1 0 0-1 0 0
还原器2容器已终止1 0 0 1 0 0
----------------------------------------------------------------------------------------------
顶点：00/02[>>-----------------------------------]0%运行时间：0.17秒
----------------------------------------------------------------------------------------------
状态：失败
顶点失败，vertexName=Map 1，vertexId=Vertex_1469720608711_0011_1_00，诊断=[顶点_1469720608711_0011_1_00[贴图1]由于以下原因导致终止/失败：INIT_失败，无法创建InputInitializerManager，org.apache.tez.dag.api.TezReflectionException:无法使用1个参数实例化类：org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator
位于org.apache.tez.common.ReflectionUtils.getNewInstance（ReflectionUtils.java:70）
位于org.apache.tez.common.ReflectionUtils.createClazzInstance（ReflectionUtils.java:89）
位于org.apache.tez.dag.app.dag.RootInputInitializerManager.createInitializer（RootInputInitializerManager.java:138）
位于org.apache.tez.dag.app.dag.RootInputInitializerManager.runInputInitializers（RootInputInitializerManager.java:115）
位于org.apache.tez.dag.app.dag.impl.VertexImpl.setupInputInitializerManager（VertexImpl.java:4676）
org.apache.tez.dag.app.dag.impl.VertexImpl.access$4300（VertexImpl.java:204）
在org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.handleInitEvent（VertexImpl.java:3445）上
位于org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition（VertexImpl.java:3394）
位于org.apache.tez.dag.app.dag.impl.VertexImpl$InitTransition.transition（VertexImpl.java:3375）
位于org.apache.hadoop.warn.state.StateMachineFactory$MultipleInternalArc.doTransition（StateMachineFactory.java:385）
位于org.apache.hadoop.warn.state.StateMachineFactory.doTransition（StateMachineFactory.java:302）
位于org.apache.hadoop.warn.state.StateMachineFactory.access$300（StateMachineFactory.java:46）
位于org.apache.hadoop.warn.state.StateMachineFactory$InternalStateMachine.doTransition（StateMachineFactory.java:448）
位于org.apache.tez.state.stateMachinetz.doTransition（stateMachinetz.java:57）
位于org.apache.tez.dag.app.dag.impl.VertexImpl.handle（VertexImpl.java:1975）
位于org.apache.tez.dag.app.dag.impl.VertexImpl.handle（VertexImpl.java:203）
位于org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle（DAGAppMaster.java:2090）
位于org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle（DAGAppMaster.java:2076）
位于org.apache.tez.common.AsyncDispatcher.dispatch（AsyncDispatcher.java:183）
位于org.apache.tez.common.AsyncDispatcher$1.run（AsyncDispatcher.java:114）
运行（Thread.java:745）
原因：java.lang.reflect.InvocationTargetException
位于sun.reflect.NativeConstructorAccessorImpl.newInstance0（本机方法）
位于sun.reflect.NativeConstructorAccessorImpl.newInstance（NativeConstructorAccessorImpl.java:62）
在sun.reflect.DelegatingConstructorAccessorImpl.newInstance（DelegatingConstructorAccessorImpl.java:45）
位于java.lang.reflect.Constructor.newInstance（Constructor.java:422）
位于org.apache.tez.common.ReflectionUtils.getNewInstance（ReflectionUtils.java:68）
…还有20个
原因：java.lang.NoClassDefFoundError:org/apache/hadoop/mapred/split/SplitLocationProvider
位于org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator（HiveSplitGenerator.java:96）
…还有25个
原因：java.lang.ClassNotFoundException:org.apache.hadoop.mapred.split.SplitLocationProvider
位于java.net.URLClassLoader.findClass（URLClassLoader.java:381）
位于java.lang.ClassLoader.loadClass（ClassLoader.java:424）
位于sun.misc.Launcher$AppClassLoader.loadClass（Launcher.java:331）
位于java.lang.ClassLoader.loadClass（ClassLoader.java:357）
…还有26个
]
顶点终止，vertexName=Reducer 2，vertexId=Vertex_1469720608711_0011_1_01，诊断=[顶点在新状态下收到终止，Vertex Vertex_1469720608711_0011_1_01[还原器2]终止/失败，原因是：其他顶点失败]
由于VERTEX\u故障，DAG未成功。失败顶点：1终止顶点：1
Exception in thread "main" java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1550)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3080)
at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3108)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:543)
at org.apache.hadoop.hive.ql.session.SessionState.beginStart(SessionState.java:516)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:712)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1548)
... 14 more
Caused by: java.lang.IllegalArgumentException: Unrecognized Hadoop major version number: 1.2.1
at org.apache.hadoop.hive.shims.ShimLoader.getMajorVersion(ShimLoader.java:165)
at org.apache.hadoop.hive.shims.ShimLoader.loadShims(ShimLoader.java:132)
at org.apache.hadoop.hive.shims.ShimLoader.getHadoopShims(ShimLoader.java:93)
at org.apache.hadoop.hive.metastore.ObjectStore.getDataSourceProps(ObjectStore.java:376)
at org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:268)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:58)
at org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:67)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:517)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:482)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:544)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:370)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5762)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:219)
at org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:67)