Warning: file_get_contents(/data/phpspider/zhask/data//catemap/9/java/363.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181

Warning: file_get_contents(/data/phpspider/zhask/data//catemap/0/hadoop/6.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Java 由于cloudera quickstart vm中的纱线容器错误,Hipi平均像素数程序失败_Java_Hadoop_Cloudera Quickstart Vm_Hipi - Fatal编程技术网

Java 由于cloudera quickstart vm中的纱线容器错误,Hipi平均像素数程序失败

Java 由于cloudera quickstart vm中的纱线容器错误,Hipi平均像素数程序失败,java,hadoop,cloudera-quickstart-vm,hipi,Java,Hadoop,Cloudera Quickstart Vm,Hipi,我是HIPI/Hadoop的新手,所以我选择cloudera quickstart vm(5.4.2)。我是按照教程来做的。 运行时,我发现hib文件中有如下所示的文件: [cloudera@quickstart tools]$ ./hibInfo.sh examples/sampleNew.hib --show-meta Input HIB: examples/sampleNew.hib Display meta data: true Display EXIF data: false I

我是HIPI/Hadoop的新手,所以我选择cloudera quickstart vm(5.4.2)。我是按照教程来做的。 运行时,我发现hib文件中有如下所示的文件:

[cloudera@quickstart tools]$ ./hibInfo.sh examples/sampleNew.hib --show-meta



Input HIB: examples/sampleNew.hib
Display meta data: true
Display EXIF data: false
IMAGE INDEX: 0
   1244 x 829
   format: 1
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/01.jpg}
IMAGE INDEX: 1
   1106 x 829
   format: 1
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/02.jpg}
IMAGE INDEX: 2
   933 x 700
   format: 1
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/03.jpg}
IMAGE INDEX: 3
   1106 x 829
   format: 1
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/04.jpg}
IMAGE INDEX: 4
   1244 x 829
   format: 1
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/05.jpg}
IMAGE INDEX: 5
   1555 x 1166
   format: 1
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/06.jpg}
IMAGE INDEX: 6
   1244 x 829
   format: 1
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/07.jpg}
IMAGE INDEX: 7
   1244 x 829
   format: 1
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/08.jpg}
IMAGE INDEX: 8
   576 x 383
   format: 1
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/09.jpg}
IMAGE INDEX: 9
   576 x 383
   format: 1
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/10.jpg}
IMAGE INDEX: 10
   737 x 475
   format: 1
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/11.jpg}
IMAGE INDEX: 11
   614 x 460
   format: 2
   meta: {source=/home/cloudera/Downloads/hipi-release/web/examples/testimages/12.png}
Found [12] images.
但是,当我尝试使用jar文件执行时,我得到了以下错误:

[cloudera@quickstart helloWorld]$ hadoop jar build/libs/helloWorld.jar examples/sampleNew.hib sampleimages_average
15/10/27 03:22:30 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
15/10/27 03:22:37 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
15/10/27 03:22:40 INFO input.FileInputFormat: Total input paths to process : 1
Spawned 1map tasks
15/10/27 03:22:48 INFO mapreduce.JobSubmitter: number of splits:1
15/10/27 03:22:50 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1445938202522_0003
15/10/27 03:23:00 INFO impl.YarnClientImpl: Submitted application application_1445938202522_0003
15/10/27 03:23:00 INFO mapreduce.Job: The url to track the job: http://quickstart.cloudera:8088/proxy/application_1445938202522_0003/
15/10/27 03:23:00 INFO mapreduce.Job: Running job: job_1445938202522_0003
15/10/27 03:23:43 INFO mapreduce.Job: Job job_1445938202522_0003 running in uber mode : false
15/10/27 03:23:43 INFO mapreduce.Job:  map 0% reduce 0%
15/10/27 03:23:43 INFO mapreduce.Job: Job job_1445938202522_0003 failed with state FAILED due to: Application application_1445938202522_0003 failed 2 times due to AM Container for appattempt_1445938202522_0003_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://quickstart.cloudera:8088/proxy/application_1445938202522_0003/Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1445938202522_0003_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 
    at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
    at org.apache.hadoop.util.Shell.run(Shell.java:455)
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
    at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
    at java.util.concurrent.FutureTask.run(FutureTask.java:262)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)


Container exited with a non-zero exit code 1
资源管理器下的日志文件显示:

Failed while trying to construct the redirect url to the log server. Log Server url may not be configured
java.lang.Exception: Unknown container. Container either has not started or has already completed or doesn't belong to this node at all.
帮帮我。我找不到错误

我使用的是Java 1.8,Hadoop 2.6.0-cdh5.4.2

HADOOP_类路径:/usr/lib/HADOOP/lib HADOOP_-Thread_-HOME:/usr/lib/HADOOP-Thread HADOOP\u MAPRED\u HOME:/usr/lib/HADOOP mapreduce HADOOP_CONF_DIR:/etc/HADOOP/CONF


我已经用wordcount示例进行了测试,这是一个成功的例子。

我修复了这个问题,恢复了我的java版本,这是两个HIPI和hadoop之间的不匹配。我用hadoop java版本构建hipi,这个问题就解决了。

我在系统中使用java 1.8.0_77版本,在服务器中使用java 1.8.0_91。我在运行时遇到相同的容器问题。构建版本更改是否会出现任何问题?这是可能的。请查收。