Java 在我的项目中运行giraph作业时未找到获取类异常
我编写了自己的计算(合并计算)。当我在单个节点上运行我的项目时,我得到了错误java.lang.ClassNotFoundException 以下是我加载的方式:Java 在我的项目中运行giraph作业时未找到获取类异常,java,hadoop,jar,giraph,Java,Hadoop,Jar,Giraph,我编写了自己的计算(合并计算)。当我在单个节点上运行我的项目时,我得到了错误java.lang.ClassNotFoundException 以下是我加载的方式: GiraphConfiguration conf = new GiraphConfiguration(); conf.setComputationClass(MergeComputation.class); 我尝试了所有可能的方法: bin/hadoop jar contrail-1.0-SNAPSHOT-job.jar cont
GiraphConfiguration conf = new GiraphConfiguration();
conf.setComputationClass(MergeComputation.class);
我尝试了所有可能的方法:
bin/hadoop jar contrail-1.0-SNAPSHOT-job.jar contrail.GraphMerge giraphIn giraphout 2 -libjars myproject.jar,giraph-1.1.0-SNAPSHOT-for-hadoop-1.0.2-jar-with-dependencies.jar
我的HADOOP_类路径:
/Users/vidyasagar/Documents/hadoop-1.1.2/libexec/../giraph-1.1.0-SNAPSHOT-for-hadoop-1.0.2-jar-with-dependencies.jar:/Users/vidyasagar/Documents/hadoop-1.1.2/libexec/../myProject.jar
我得到以下错误
java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: contrail.MergeComputation
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:881)
at org.apache.giraph.conf.ClassConfOption.get(ClassConfOption.java:108)
at org.apache.giraph.utils.ConfigurationUtils.getTypesHolderClass(ConfigurationUtils.java:144)
at org.apache.giraph.conf.GiraphTypes.readFrom(GiraphTypes.java:97)
at org.apache.giraph.conf.GiraphClasses.<init>(GiraphClasses.java:155)
at org.apache.giraph.conf.ImmutableClassesGiraphConfiguration.<init>(ImmutableClassesGiraphConfiguration.java:99)
at org.apache.giraph.bsp.BspOutputFormat.getOutputCommitter(BspOutputFormat.java:56)
at org.apache.hadoop.mapred.Task.initialize(Task.java:515)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:353)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: contrail.MergeComputation
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:849)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:873)
... 13 more
Caused by: java.lang.ClassNotFoundException: contrail.MergeComputation
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:802)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:847)
... 14 more
java.lang.RuntimeException:java.lang.RuntimeException:java.lang.ClassNotFoundException:Tracil.MergeComputing
位于org.apache.hadoop.conf.Configuration.getClass(Configuration.java:881)
位于org.apache.giraph.conf.ClassConfOption.get(ClassConfOption.java:108)
位于org.apache.giraph.utils.ConfigurationUtils.getTypesHolderClass(ConfigurationUtils.java:144)
位于org.apache.giraph.conf.GiraphTypes.readFrom(GiraphTypes.java:97)
位于org.apache.giraph.conf.GiraphClasses(GiraphClasses.java:155)
位于org.apache.giraph.conf.ImmutableClassesGiraphConfiguration。(ImmutableClassesGiraphConfiguration.java:99)
位于org.apache.giraph.bsp.BspOutputFormat.getOutputCommitter(BspOutputFormat.java:56)
位于org.apache.hadoop.mapred.Task.initialize(Task.java:515)
位于org.apache.hadoop.mapred.MapTask.run(MapTask.java:353)
位于org.apache.hadoop.mapred.Child$4.run(Child.java:255)
位于java.security.AccessController.doPrivileged(本机方法)
位于javax.security.auth.Subject.doAs(Subject.java:396)
位于org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
位于org.apache.hadoop.mapred.Child.main(Child.java:249)
原因:java.lang.RuntimeException:java.lang.ClassNotFoundException:Tracil.MergeComputement
位于org.apache.hadoop.conf.Configuration.getClass(Configuration.java:849)
位于org.apache.hadoop.conf.Configuration.getClass(Configuration.java:873)
... 还有13个
原因:java.lang.ClassNotFoundException:contail.MergeComputement
位于java.net.URLClassLoader$1.run(URLClassLoader.java:202)
位于java.security.AccessController.doPrivileged(本机方法)
位于java.net.URLClassLoader.findClass(URLClassLoader.java:190)
位于java.lang.ClassLoader.loadClass(ClassLoader.java:306)
位于sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
位于java.lang.ClassLoader.loadClass(ClassLoader.java:247)
位于java.lang.Class.forName0(本机方法)
位于java.lang.Class.forName(Class.java:247)
位于org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:802)
位于org.apache.hadoop.conf.Configuration.getClass(Configuration.java:847)
... 14多
有人能帮我一下吗。你把你的
trail.MergeComputation
打包到哪个罐子里了?确保它包含在-libjars
arguments.contrail.MergeComputation的contrail-1.0-SNAPSHOT-job.jar中,并且我正在运行命令bin/hadoop-jar contrail-1.0-SNAPSHOT-job.jar contrail.GraphMerge giraphIn giraphout 2-libjars contrail-1.0-SNAPSHOT-job.jar,giraph-1.1.0-SNAPSHOT-for-hadoop-1.0.2-jar-with-dependencies.jar您只需尝试一次:GiraphConfiguration conf=new-GiraphConfiguration(getConf())代码>