Apache pig Pig错误1066:无法打开别名tweetsReduced的迭代器

Apache pig Pig错误1066:无法打开别名tweetsReduced的迭代器,apache-pig,Apache Pig,我在本地模式下运行Pig,我得到了这个错误 我正在执行的脚本是: REGISTER '/users/level3/1103816b/Desktop/HotOrNot_repo/DataMining/Pig/piggybank.jar'; venues = LOAD '/users/level3/1103816b/Desktop/HotOrNot_repo/DataMining/Pig/venues_extended.csv' USING org.apache.pig.piggybank.sto

我在本地模式下运行Pig,我得到了这个错误

我正在执行的脚本是:

REGISTER '/users/level3/1103816b/Desktop/HotOrNot_repo/DataMining/Pig/piggybank.jar';

venues = LOAD '/users/level3/1103816b/Desktop/HotOrNot_repo/DataMining/Pig/venues_extended.csv' USING org.apache.pig.piggybank.storage.CSVLoader();

venuesReduced = foreach venues generate venues::Name;

DUMP tweetsReduced;
错误日志:

2013-12-01 21:06:59,270 [main] ERROR org.apache.pig.tools.grunt.Grunt - org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias venuesReduced
    at org.apache.pig.PigServer.openIterator(PigServer.java:880)
    at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:774)
    at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:372)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173)
    at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
    at org.apache.pig.Main.run(Main.java:607)
    at org.apache.pig.Main.main(Main.java:156)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias venuesReduced
    at org.apache.pig.PigServer.storeEx(PigServer.java:982)
    at org.apache.pig.PigServer.store(PigServer.java:942)
    at org.apache.pig.PigServer.openIterator(PigServer.java:855)
    ... 7 more
Caused by: org.apache.pig.impl.plan.PlanValidationException: ERROR 1025: 
<file /users/level3/1103816b/Desktop/HotOrNot_repo/DataMining/Pig/venues_count.pig, line 7, column 40> Invalid field projection. Projected field [venues::Name] does not exist.
    at org.apache.pig.newplan.logical.expression.ProjectExpression.findColNum(ProjectExpression.java:191)
    at org.apache.pig.newplan.logical.expression.ProjectExpression.setColumnNumberFromAlias(ProjectExpression.java:174)
    at org.apache.pig.newplan.logical.visitor.ColumnAliasConversionVisitor$1.visit(ColumnAliasConversionVisitor.java:53)
    at org.apache.pig.newplan.logical.expression.ProjectExpression.accept(ProjectExpression.java:215)
    at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
    at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
    at org.apache.pig.newplan.logical.optimizer.AllExpressionVisitor.visit(AllExpressionVisitor.java:142)
    at org.apache.pig.newplan.logical.relational.LOInnerLoad.accept(LOInnerLoad.java:128)
    at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
    at org.apache.pig.newplan.logical.optimizer.AllExpressionVisitor.visit(AllExpressionVisitor.java:124)
    at org.apache.pig.newplan.logical.relational.LOForEach.accept(LOForEach.java:76)
    at org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
    at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
    at org.apache.pig.PigServer$Graph.compile(PigServer.java:1716)
    at org.apache.pig.PigServer$Graph.compile(PigServer.java:1708)
    at org.apache.pig.PigServer$Graph.access$200(PigServer.java:1409)
    at org.apache.pig.PigServer.storeEx(PigServer.java:977)
    ... 9 more
2013-12-01 21:06:59270[main]错误org.apache.pig.tools.grunt.grunt-org.apache.pig.impl.logicalayer.FrontendException:错误1066:无法打开别名的迭代器
位于org.apache.pig.PigServer.openIterator(PigServer.java:880)
位于org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:774)
位于org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:372)
位于org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
位于org.apache.pig.tools.grunt.GruntParser.parsetoponerror(GruntParser.java:173)
位于org.apache.pig.tools.grunt.grunt.exec(grunt.java:84)
位于org.apache.pig.Main.run(Main.java:607)
位于org.apache.pig.Main.Main(Main.java:156)
原因:org.apache.pig.PigException:错误1002:无法存储别名venuesReduced
位于org.apache.pig.PigServer.storeEx(PigServer.java:982)
位于org.apache.pig.PigServer.store(PigServer.java:942)
位于org.apache.pig.PigServer.openIterator(PigServer.java:855)
... 还有7个
原因:org.apache.pig.impl.plan.PlanValidationException:错误1025:
无效的字段投影。投影字段[场馆::名称]不存在。
位于org.apache.pig.newplan.logical.expression.ProjectExpression.findColNum(ProjectExpression.java:191)
位于org.apache.pig.newplan.logical.expression.ProjectExpression.setColumnNumberFromAlias(ProjectExpression.java:174)
位于org.apache.pig.newplan.logical.visitor.ColumnAliasConversionVisitor$1.visit(ColumnAliasConversionVisitor.java:53)
位于org.apache.pig.newplan.logical.expression.ProjectExpression.accept(ProjectExpression.java:215)
位于org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
访问org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
位于org.apache.pig.newplan.logical.optimizer.AllExpressionVisitor.visit(AllExpressionVisitor.java:142)
位于org.apache.pig.newplan.logical.relational.LOInnerLoad.accept(LOInnerLoad.java:128)
位于org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
位于org.apache.pig.newplan.logical.optimizer.AllExpressionVisitor.visit(AllExpressionVisitor.java:124)
位于org.apache.pig.newplan.logical.relational.LOForEach.accept(LOForEach.java:76)
位于org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
访问org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
位于org.apache.pig.PigServer$Graph.compile(PigServer.java:1716)
位于org.apache.pig.PigServer$Graph.compile(PigServer.java:1708)
位于org.apache.pig.PigServer$Graph.access$200(PigServer.java:1409)
位于org.apache.pig.PigServer.storeEx(PigServer.java:977)
... 9更多
我不确定可能是什么问题,我相信
CSV
文件是正确的。问题出在
CSV
文件上吗?它有点大,所以我不能把它放在这里。有趣的是,错误是
字段投影无效。投影字段[场馆::名称]不存在。
但在他
CSV
文件中有一个字段被称为这样的字段

任何关于可能导致此错误发生的原因的想法都是非常受欢迎的

错误似乎是“场投影无效。投影场[Vinces::Name]不存在”。这意味着您在加载数据时缺少“AS”子句

使用org.apache.pig.piggybank.storage.CSVLoader()作为(名称:chararray,…)加载“/input”


似乎您的namenode处于安全模式。 使用此cmd强制将namenode移出安全模式

hdfs dfsadmin-安全模式离开


然后使用pig拉丁语“dump”命令。

能否显示
描述场馆的结果
?@WinnieNicklaus不,它是说架构未知或类似的东西。您的输入文件是什么样子的?对于在查找此处时找到此帖子的人来说,是的,可能是这样:)不,我收到另一个错误
无法初始化集群
,但这与Hadoop有关。谢谢:)