Warning: file_get_contents(/data/phpspider/zhask/data//catemap/1/dart/3.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Hadoop Mahout群集崩溃_Hadoop_Mahout - Fatal编程技术网

Hadoop Mahout群集崩溃

Hadoop Mahout群集崩溃,hadoop,mahout,Hadoop,Mahout,在某些机器上,我在运行KMeans时遇到以下错误: java.io.FileNotFoundException: File file:/home/daniel/Aimee/agent/big-data/mahout-clusters/target/output/clusters-0-final/_policy does not exist. at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.ja

在某些机器上,我在运行KMeans时遇到以下错误:

java.io.FileNotFoundException: File file:/home/daniel/Aimee/agent/big-data/mahout-clusters/target/output/clusters-0-final/_policy does not exist.
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:371) ~[hadoop-core-0.20.204.0.jar:na]
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245) ~[hadoop-core-0.20.204.0.jar:na]
at org.apache.hadoop.fs.FileSystem.getLength(FileSystem.java:720) ~[hadoop-core-0.20.204.0.jar:na]
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1417) ~[hadoop-core-0.20.204.0.jar:na]
at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1412) ~[hadoop-core-0.20.204.0.jar:na]
at org.apache.mahout.clustering.classify.ClusterClassifier.readPolicy(ClusterClassifier.java:223) ~[mahout-core-0.7.jar:0.7]
at org.apache.mahout.clustering.classify.ClusterClassificationMapper.setup(ClusterClassificationMapper.java:75) ~[mahout-core-0.7.jar:0.7]
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142) ~[hadoop-core-0.20.204.0.jar:na]
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) ~[hadoop-core-0.20.204.0.jar:na]
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) ~[hadoop-core-0.20.204.0.jar:na]
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212) ~[hadoop-core-0.20.204.0.jar:na]
java.io.FileNotFoundException:File文件:/home/daniel/Aimee/agent/big data/mahout clusters/target/output/clusters-0-final/\u策略不存在。
在org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:371)~[hadoop-core-0.20.204.0.jar:na]
在org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)~[hadoop-core-0.20.204.0.jar:na]
在org.apache.hadoop.fs.FileSystem.getLength(FileSystem.java:720)~[hadoop-core-0.20.204.0.jar:na]
在org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:1417)~[hadoop-core-0.20.204.0.jar:na]
在org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:1412)~[hadoop-core-0.20.204.0.jar:na]
在org.apache.mahout.clustering.classify.ClusterClassifier.readPolicy(ClusterClassifier.java:223)~[mahout-core-0.7.jar:0.7]
在org.apache.mahout.clustering.classify.ClusterClassificationMapper.setup(ClusterClassificationMapper.java:75)~[mahout-core-0.7.jar:0.7]
在org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)~[hadoop-core-0.20.204.0.jar:na]
在org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)~[hadoop-core-0.20.204.0.jar:na]
在org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)~[hadoop-core-0.20.204.0.jar:na]
在org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)~[hadoop-core-0.20.204.0.jar:na]
似乎某个文件由于某种原因没有生成。 我试着用谷歌搜索一下,但是网上没有关于这类问题的记录。我使用mahout核心0.7,它使用hadoop核心0.20.204.0。
谢谢你提供任何线索,这个问题占用了我的时间-(

好的,我花了一些时间来解决这个问题,所以我把这个答案留给任何可能遇到这个问题的人。原因是因为我使用了canopy来计算KMeans的第一个中心,并且canopy没有配置runClustering=true,所以它没有生成_策略文件。但是,这种行为是不一致的。在某些机器上,该文件正在生成,而与runClustering值无关