Hadoop streaming mapreduce未运行

Hadoop streaming mapreduce未运行,mapreduce,hadoop-streaming,Mapreduce,Hadoop Streaming,我已经从下载了Hadoop2.6.0和HadoopStreaming(因为我没有空间运行CDH或Sandbox) 我指挥 bin/hadoop jar contrib/hadoop-streaming-2.6.0.jar \ -file ${HADOOP_HOME}/py_mapred/mapper.py -mapper ${HADOOP_HOME}/py_mapred/mapper.py \ -file ${HADOOP_HOME}/py_mapred/reducer.py -reducer

我已经从下载了Hadoop2.6.0和HadoopStreaming(因为我没有空间运行CDH或Sandbox)

我指挥

bin/hadoop jar contrib/hadoop-streaming-2.6.0.jar \
-file ${HADOOP_HOME}/py_mapred/mapper.py -mapper ${HADOOP_HOME}/py_mapred/mapper.py \
-file ${HADOOP_HOME}/py_mapred/reducer.py -reducer ${HADOOP_HOME}/py_mapred/reducer.py \
-input /input/davinci/* -output /input/davinci-output
我将下载的流媒体jar存储在${HADOOP_HOME}/contrib中,其他文件存储在py_mapred中。同时,我将从本地复制到hdfs上的/input目录。现在,当我运行该命令时,将显示以下行:

15/08/14 17:35:45 WARN streaming.StreamJob: -file option is deprecated, please use generic option -files instead.
15/08/14 17:35:46 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
packageJobJar: [/usr/local/cellar/hadoop/2.6.0/py_mapred/mapper.py, /usr/local/cellar/hadoop/2.6.0/py_mapred/reducer.py, /var/folders/c5/4xfj65v15g91f71c_b9whnpr0000gn/T/hadoop-unjar3313567263260134566/] [] /var/folders/c5/4xfj65v15g91f71c_b9whnpr0000gn/T/streamjob9165494241574343777.jar tmpDir=null
15/08/14 17:35:47 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
15/08/14 17:35:47 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
15/08/14 17:35:48 INFO mapred.FileInputFormat: Total input paths to process : 1
15/08/14 17:35:48 INFO mapreduce.JobSubmitter: number of splits:2
15/08/14 17:35:48 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1439538212023_0002
15/08/14 17:35:49 INFO impl.YarnClientImpl: Submitted application application_1439538212023_0002
15/08/14 17:35:49 INFO mapreduce.Job: The url to track the job: http://Jonathans-MacBook-Pro.local:8088/proxy/application_1439538212023_0002/
15/08/14 17:35:49 INFO mapreduce.Job: Running job: job_1439538212023_0002
看起来该命令已被接受。我检查了localhost:8088,作业确实注册了。但是它没有运行,尽管它说的是
正在运行job:job\u 14395388212023\u 0002
。我的命令有什么问题吗?这是由于权限设置造成的吗?为什么作业没有运行


谢谢

以下是流媒体的正确方式:

bin/hadoop jar contrib/hadoop-streaming-2.6.0.jar \
-file ${HADOOP_HOME}/py_mapred/mapper.py -mapper '/usr/bin/python mapper.py' -file ${HADOOP_HOME}/py_mapred/reducer.py -reducer '/usr/bin/python reducer.py' -input /input/davinci/* -output /input/davinci-output

我也遇到过类似的问题。