Apache pig 错误[main]2997:无法从后端重新创建异常错误:org.apache.pig.backend.executionengine.ExecutionException

Apache pig 错误[main]2997:无法从后端重新创建异常错误:org.apache.pig.backend.executionengine.ExecutionException,apache-pig,Apache Pig,我用pig创建了下面的脚本。我对猪和猪拉丁语很陌生。我还在学习如何有效地使用PIG脚本 执行脚本时,我出现以下错误: 错误[main]org.apache.pig.tools.grunt.grunt-错误2997:无法从后端重新创建异常错误:org.apache.pig.backend.executionengine.exeception 有人能解释一下原因吗?我怎样才能改正呢。在csv文件中,我有除rate列以外的所有char列,rate列有整数值 *divs = LOAD 'output\f

我用pig创建了下面的脚本。我对猪和猪拉丁语很陌生。我还在学习如何有效地使用PIG脚本

执行脚本时,我出现以下错误:

错误[main]org.apache.pig.tools.grunt.grunt-错误2997:无法从后端重新创建异常错误:org.apache.pig.backend.executionengine.exeception

有人能解释一下原因吗?我怎样才能改正呢。在csv文件中,我有除rate列以外的所有char列,rate列有整数值

*divs = LOAD 'output\file.csv' using PigStorage(',') AS (uniID:chararray, deal:chararray, rol: chararray,name:chararray,add:chararray,city:chararray,stat:chararray,stn:chararray,zip:chararray,country:chararray,db:chararray,sm:chararray,rate:int);
DUMP divs;
trimmed = foreach divs generate sm,uniID,rol,rate,country;
DUMP trimmed;
grpd = group trimmed by sm;
orderd = order trimmed by country;
describe trimmed;
describe grpd;
DUMP grpd;
describe orderd;
avgdiv = foreach grpd generate sm, AVG(divs.rate), SUM(divs.rate), MAX(divs.rate);
DUMP avgdiv;
store avgdiv into 'output/pigdescribe1out';
explain;*

您的group语句返回一个错误。您试图在分组之前聚合数据,因此出现错误

divs = LOAD '$input' using PigStorage('^A') AS (uniID:chararray, deal:chararray, rol: chararray,name:chararray,add:chararray,city:chararray,stat:chararray,stn:chararray,zip:chararray,country:chararray,db:chararray,sm:chararray,rate:int);<br/>
DUMP divs;
trimmed = foreach divs generate sm,uniID,rol,rate,country;
DUMP trimmed;
grpd = group trimmed by sm;
orderd = order trimmed by country;
describe trimmed;
describe grpd;
DUMP grpd;
describe orderd;
avgdiv = foreach grpd generate FLATTEN(group), AVG(trimmed.rate), SUM(trimmed.rate), MAX(trimmed.rate);
DUMP avgdiv;
store avgdiv into 'data/sampledata/';
explain;
divs=使用PigStorage(“^A”)加载“$input”为(uniID:CHARRAY,deal:CHARRAY,rol:CHARRAY,name:CHARRAY,add:CHARRAY,city:CHARRAY,stat:CHARRAY,stn:CHARRAY,zip:CHARRAY,country:CHARRAY,db:CHARRAY,sm:CHARRAY,rate:int)
倾倒区; 修剪=每个div生成sm、uniID、rol、速率、国家/地区; 垃圾场修整; grpd=由sm修剪的组; orderd=按国家/地区调整的订单; 描述修剪; 描述grpd; 垃圾场grpd; 描述订单; avgdiv=foreach grpd生成展平(组)、平均(修剪速率)、总和(修剪速率)、最大(修剪速率); 转储avgdiv; 将avgdiv存储到“data/sampledata/”中; 解释;

这非常好。

您的group语句返回一个错误。您试图在分组之前聚合数据,因此出现错误

divs = LOAD '$input' using PigStorage('^A') AS (uniID:chararray, deal:chararray, rol: chararray,name:chararray,add:chararray,city:chararray,stat:chararray,stn:chararray,zip:chararray,country:chararray,db:chararray,sm:chararray,rate:int);<br/>
DUMP divs;
trimmed = foreach divs generate sm,uniID,rol,rate,country;
DUMP trimmed;
grpd = group trimmed by sm;
orderd = order trimmed by country;
describe trimmed;
describe grpd;
DUMP grpd;
describe orderd;
avgdiv = foreach grpd generate FLATTEN(group), AVG(trimmed.rate), SUM(trimmed.rate), MAX(trimmed.rate);
DUMP avgdiv;
store avgdiv into 'data/sampledata/';
explain;
divs=使用PigStorage(“^A”)加载“$input”为(uniID:CHARRAY,deal:CHARRAY,rol:CHARRAY,name:CHARRAY,add:CHARRAY,city:CHARRAY,stat:CHARRAY,stn:CHARRAY,zip:CHARRAY,country:CHARRAY,db:CHARRAY,sm:CHARRAY,rate:int)
倾倒区; 修剪=每个div生成sm、uniID、rol、速率、国家/地区; 垃圾场修整; grpd=由sm修剪的组; orderd=按国家/地区调整的订单; 描述修剪; 描述grpd; 垃圾场grpd; 描述订单; avgdiv=foreach grpd生成展平(组)、平均(修剪速率)、总和(修剪速率)、最大(修剪速率); 转储avgdiv; 将avgdiv存储到“data/sampledata/”中; 解释;

这工作得非常好。

您尝试插入图像时出现了一些残留代码。是否要包含一个?尝试插入图像时出现了一些残留代码。你想不想包括一个?