Java Hadoop-启动映射作业时出错，退出代码：1
我正在尝试从Hadoop中的独立java文件启动映射作业，该作业是一个简单的wordcount程序，用于从hadoopfs中的文件计算单词，作业失败，我收到以下消息：Java Hadoop-启动映射作业时出错，退出代码：1,java,hadoop,mapreduce,log4j,Java,Hadoop,Mapreduce,Log4j,我正在尝试从Hadoop中的独立java文件启动映射作业，该作业是一个简单的wordcount程序，用于从hadoopfs中的文件计算单词，作业失败，我收到以下消息： 2021-05-06 21:07:10,958 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032 2021-05-06 21:07:11,122 INFO mapreduce.JobResourceUploader: Disabling Era
2021-05-06 21:07:10,958 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
2021-05-06 21:07:11,122 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/walid/.staging/job_1620323398249_0027
2021-05-06 21:07:11,222 INFO input.FileInputFormat: Total input files to process : 1
2021-05-06 21:07:11,245 INFO mapreduce.JobSubmitter: number of splits:1
2021-05-06 21:07:11,341 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1620323398249_0027
2021-05-06 21:07:11,342 INFO mapreduce.JobSubmitter: Executing with tokens: []
2021-05-06 21:07:11,423 INFO conf.Configuration: resource-types.xml not found
2021-05-06 21:07:11,423 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2021-05-06 21:07:11,448 INFO impl.YarnClientImpl: Submitted application application_1620323398249_0027
2021-05-06 21:07:11,462 INFO mapreduce.Job: The url to track the job: http://walidpc:8088/proxy/application_1620323398249_0027/
2021-05-06 21:07:11,463 INFO mapreduce.Job: Running job: job_1620323398249_0027
2021-05-06 21:07:28,563 INFO mapreduce.Job: Job job_1620323398249_0027 running in uber mode : false
2021-05-06 21:07:28,565 INFO mapreduce.Job: map 0% reduce 0%
2021-05-06 21:07:28,586 INFO mapreduce.Job: Job job_1620323398249_0027 failed with state FAILED due to: Application application_1620323398249_0027 failed 2 times due to AM Container for appattempt_1620323398249_0027_000002 exited with exitCode: 1
Failing this attempt.Diagnostics: [2021-05-06 21:07:28.452]Exception from container-launch.
Container id: container_1620323398249_0027_02_000001
Exit code: 1
[2021-05-06 21:07:28.455]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
[2021-05-06 21:07:28.456]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
log4j:WARN No appenders could be found for logger (org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
For more detailed output, check the application tracking page: http://walidpc:8088/cluster/app/application_1620323398249_0027 Then click on links to logs of each attempt.
. Failing the application.
2021-05-06 21:07:28,603 INFO mapreduce.Job: Counters: 0
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.env-whitelist</name>
<value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREP
END_DISTCACHE,HADOOP_YARN_HOME,HADOOP_MAPRED_HOME</value>
</property>
<property>
<name>yarn.application.classpath</name>
<value>
/home/walid/hadoop-3.2.2\etc\hadoop,
/home/walid/hadoop-3.2.2\share\hadoop\common\*,
/home/walid/hadoop-3.2.2\share\hadoop\common\lib\*,
/home/walid/hadoop-3.2.2\share\hadoop\hdfs\*,
/home/walid/hadoop-3.2.2\share\hadoop\hdfs\lib\*,
/home/walid/hadoop-3.2.2\share\hadoop\mapreduce\*,
/home/walid/hadoop-3.2.2\share\hadoop\mapreduce\lib\*,
/home/walid/hadoop-3.2.2\share\hadoop\yarn\*,
/home/walid/hadoop-3.2.2\share\hadoop\yarn\lib\*
</value>
<value> $HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/share/hadoop/common/*,$HADOOP_COMMON_HOME/share/hadoop/common/lib/*,$HADOOP_HDFS_HOME/share/hadoop/hdfs/*,$HADOOP_HDFS_HOME/sha>
$HADOOP_YARN_HOME/share/hadoop/yarn/*,$HADOOP_YARN_HOME/share/hadoop/yarn/lib/*,$HADOOP_CONF_DIR
</value>
</property>
</configuration>
纱线.节点管理器.辅助服务
mapreduce_shuffle
warn.nodemanager.env-whitelist
JAVA_HOME、HADOOP_COMMON_HOME、HADOOP_HDFS_HOME、HADOOP_CONF_DIR、CLASSPATH_PREP
END_DISTCACHE，HADOOP_Thread_HOME，HADOOP_MAPRED_HOME
.application.classpath
/home/walid/hadoop-3.2.2\etc\hadoop，
/home/walid/hadoop-3.2.2\share\hadoop\common\*，
/home/walid/hadoop-3.2.2\share\hadoop\common\lib\*，
/home/walid/hadoop-3.2.2\share\hadoop\hdfs\*，
/home/walid/hadoop-3.2.2\share\hadoop\hdfs\lib\*，
/home/walid/hadoop-3.2.2\share\hadoop\mapreduce\*，
/home/walid/hadoop-3.2.2\share\hadoop\mapreduce\lib\*，
/home/walid/hadoop-3.2.2\share\hadoop\warn\*，
/home/walid/hadoop-3.2.2\share\hadoop\warn\lib\*
$HADOOP_CONF_DIR、$HADOOP_COMMON_HOME/share/HADOOP/COMMON/*、$HADOOP_COMMON_HOME/share/HADOOP/HADOOP/COMMON/lib/*、$HADOOP_HDFS_HOME/share/HADOOP/HDFS/*、$HADOOP_HDFS_HOME/sha>
$HADOOP\u-Thread\u-HOME/share/HADOOP/Thread/*，$HADOOP\u-Thread\u-HOME/share/HADOOP/Thread/lib/*，$HADOOP\u-CONF\u-DIR
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapreduce.application.classpath</name>
<value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
</property>
<property>
<name>mapreduce.jobhistory.webapp.address</name>
<value>http://localhost:19888</value>
</property>
</configuration>
mapreduce.framework.name
纱线
mapreduce.application.classpath
$HADOOP\u MAPRED\u HOME/share/HADOOP/mapreduce/*：$HADOOP\u MAPRED\u HOME/share/HADOOP/mapreduce/lib/*
mapreduce.jobhistory.webapp.address
http://localhost:19888