Hadoop 使用hbase服务器时出现NoSuchMethodError

Hadoop 使用hbase服务器时出现NoSuchMethodError,hadoop,hbase,hortonworks-data-platform,Hadoop,Hbase,Hortonworks Data Platform,为了使用TableMapper,我在hadoop项目中包含了hbase服务器依赖项。hbase着色客户端和hbase服务器都有1.1.2版本 但在尝试运行hadoop作业时,我出现了一个与安全性相关的错误: FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster java.lang.NoSuchMethodError: org.apache.hadoop.security.a

为了使用TableMapper,我在hadoop项目中包含了hbase服务器依赖项。hbase着色客户端和hbase服务器都有1.1.2版本

但在尝试运行hadoop作业时,我出现了一个与安全性相关的错误:

 FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.lang.NoSuchMethodError: org.apache.hadoop.security.authentication.server.AuthenticationFilter.constructSecretProvider(Ljavax/servlet/ServletContext;Ljava/util/Properties;Z)Lorg/apache/hadoop/security/authentication/util/SignerSecretProvider;
    at org.apache.hadoop.http.HttpServer2.constructSecretProvider(HttpServer2.java:447)
    at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:339)
    at org.apache.hadoop.http.HttpServer2.<init>(HttpServer2.java:114)
    at org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:290)
    at org.apache.hadoop.yarn.webapp.WebApps$Builder.build(WebApps.java:261)
    at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:303)
    at org.apache.hadoop.mapreduce.v2.app.client.MRClientService.serviceStart(MRClientService.java:142)
    at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1107)
    at org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1519)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515)
    at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448)
2016-08-22 11:04:29,010 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting with status 1
FATAL[main]org.apache.hadoop.mapreduce.v2.app.MRAppMaster:启动MRAppMaster时出错
java.lang.NoSuchMethodError:org.apache.hadoop.security.authentication.server.AuthenticationFilter.constructSecretProvider(Ljavax/servlet/ServletContext;Ljava/util/Properties;Z)Lorg/apache/hadoop/security/authentication/util/SignerSecretProvider;
位于org.apache.hadoop.http.HttpServer2.constructSecretProvider(HttpServer2.java:447)
http.HttpServer2.(HttpServer2.java:339)
http.HttpServer2.(HttpServer2.java:114)
位于org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:290)
位于org.apache.hadoop.warn.webapp.WebApps$Builder.build(WebApps.java:261)
位于org.apache.hadoop.warn.webapp.WebApps$Builder.start(WebApps.java:303)
位于org.apache.hadoop.mapreduce.v2.app.client.MRClientService.serviceStart(MRClientService.java:142)
位于org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
位于org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceStart(MRAppMaster.java:1107)
位于org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
位于org.apache.hadoop.mapreduce.v2.app.MRAppMaster$4.run(MRAppMaster.java:1519)
位于java.security.AccessController.doPrivileged(本机方法)
位于javax.security.auth.Subject.doAs(Subject.java:422)
位于org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
位于org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1515)
位于org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1448)
2016-08-22 11:04:29010信息[main]org.apache.hadoop.util.ExitUtil:以状态1退出
以前有人有过这个问题吗


谢谢。

hbase着色客户端似乎引入了未着色版本的servlet api类。这可能会在部署到web服务器或任何其他希望提供不同版本的servlet api的框架时引起问题。

hbase shaded client似乎引入了未着色版本的servlet api类。这可能会在部署到web服务器或任何其他希望提供不同版本的servlet api的框架中时引起问题。

能否共享您的代码详细信息以及您的此作业是如何执行的?能否共享您的代码详细信息以及您的此作业是如何执行的?