Hadoop java.lang.IllegalStateException:未找到群集。检查您的-c路径

Hadoop java.lang.IllegalStateException:未找到群集。检查您的-c路径,hadoop,machine-learning,cluster-computing,cluster-analysis,mahout,Hadoop,Machine Learning,Cluster Computing,Cluster Analysis,Mahout,我在命令行中使用以下命令,使用Mahout kmeans算法对数据进行集群 mahout kmeans -i /vect_out/tfidf-vectors/ -c /out_canopy -o /out_kmeans -dm org.apache.mahout.common.distance.SquaredEuclideanDistanceMeasure -cd 1.0 -x 20 -cl 其中/out_canopy是包含使用Mahout canopy clustering创建的群集的

我在命令行中使用以下命令,使用Mahout kmeans算法对数据进行集群

mahout kmeans -i /vect_out/tfidf-vectors/ -c /out_canopy -o /out_kmeans -dm   
org.apache.mahout.common.distance.SquaredEuclideanDistanceMeasure -cd 1.0 -x 20 -cl
其中/out_canopy是包含使用Mahout canopy clustering创建的群集的目录,该群集包含一个
clusters-0
目录,该目录本身包含一个名为
\u logs
的目录和一个名为
part-r-00000

但它不断报告以下错误

java.lang.IllegalStateException: No clusters found. Check your -c path.
at org.apache.mahout.clustering.kmeans.KMeansMapper.setup

您确定
/out\u
是目录吗?您是否尝试过:

file /out_canopy

似乎有一个打字错误,你只想把
写出来
或类似的东西…

这是一个特别令人烦恼的问题

1. Swallow IllegalStateExceptions thrown by removeShutdownHook in FileSystem. The javadoc states:

    public boolean removeShutdownHook(Thread hook)
    Throws:
    IllegalStateException - If the virtual machine is already in the process of shutting down 

So if we are getting this exception, it MEANS we are already in the process of shutdown, so we CANNOT, try what we may, removeShutdownHook. If Runtime had a method Runtime.isShutdownInProgress(), we could have checked for it before the removeShutdownHook call. As it stands, there is no such method. In my opinion, this would be a good patch regardless of the needs for this JIRA.

2. Not send SIGTERMs from the NM to the MR-AM in the first place. Rather we should expose a mechanism for the NM to politely tell the AM its no longer needed and should shutdown asap. Even after this, if an admin were to kill the MRAppMaster with a SIGTERM, the JobHistory would be lost defeating the purpose of 3614

out_canopy确实似乎是一个目录。这就是hadoop fs-ls/给出的
drwxr-xr-x-rupinder超群0 2013-03-07 17:11/out\u canopy