Java 使用ApachePig的Wordcount示例
我不熟悉猪编程。我试着用咕噜壳。我能够得到结果。 我在本地模式下使用java进行了尝试。但是我犯了一个错误Java 使用ApachePig的Wordcount示例,java,maven,apache-pig,Java,Maven,Apache Pig,我不熟悉猪编程。我试着用咕噜壳。我能够得到结果。 我在本地模式下使用java进行了尝试。但是我犯了一个错误 17/01/06 13:51:45 INFO data.SchemaTupleFrontend: Distributed cache not supported or needed in local mode. Setting key [pig.schematuple.local.dir] with code temp directory: /tmp/1483690905600-0 Exc
17/01/06 13:51:45 INFO data.SchemaTupleFrontend: Distributed cache not supported or needed in local mode. Setting key [pig.schematuple.local.dir] with code temp directory: /tmp/1483690905600-0
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.mapred.jobcontrol.JobControl.addJob(Lorg/apache/hadoop/mapred/jobcontrol/Job;)Ljava/lang/String;
此问题是否基于版本
示例代码
public static void main(String[] args) {
PigServer pigServer = null;
try {
pigServer = new PigServer(ExecType.LOCAL, new Properties());
} catch (ExecException e1) {
// TODO Auto-generated catch block
e1.printStackTrace();
}
try {
runMyQuery(pigServer);
}
catch (IOException e) {
e.printStackTrace();
}
}
我的pom.xml
<dependency>
<groupId>org.apache.pig</groupId>
<artifactId>pig</artifactId>
<version>0.16.0</version>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-core</artifactId>
<version>2.6.0-mr1-cdh5.4.5</version>
</dependency>
org.apache.pig
猪
0.16.0
org.apache.hadoop
hadoop内核
2.6.0-mr1-cdh5.4.5
他们使用的ant可能存在重复。我正在尝试使用maven依赖项运行
<dependency>
<groupId>org.apache.pig</groupId>
<artifactId>pig</artifactId>
<version>0.16.0</version>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-core</artifactId>
<version>2.6.0-mr1-cdh5.4.5</version>
</dependency>