Warning: file_get_contents(/data/phpspider/zhask/data//catemap/0/asp.net-core/3.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Hadoop Pig映射或Reduce查询_Hadoop_Mapreduce_Apache Pig - Fatal编程技术网

Hadoop Pig映射或Reduce查询

Hadoop Pig映射或Reduce查询,hadoop,mapreduce,apache-pig,Hadoop,Mapreduce,Apache Pig,我有以下数据样本: AGE,EDU,SEX,SALARY 67,10th,Male,<=50K 17,10th,Female,<=50K 40,Assoc-voc,Male,>50K 35,Assoc-voc,Male,<=50K 57,Assoc-voc,Male,<=50K 49,Assoc-voc,Male,>50K 42,Bachelors,Male,>50K 30,Bachelors,Male,>50K 23,Bachelors,Fema

我有以下数据样本:

AGE,EDU,SEX,SALARY
67,10th,Male,<=50K
17,10th,Female,<=50K
40,Assoc-voc,Male,>50K
35,Assoc-voc,Male,<=50K
57,Assoc-voc,Male,<=50K
49,Assoc-voc,Male,>50K
42,Bachelors,Male,>50K
30,Bachelors,Male,>50K
23,Bachelors,Female,<=50K

非常感谢

是的,当您启动作业时,您将看到一个字符串

 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: Alias1[73,14] C: Alias2[20, 9] R: Alias3[90, 78]
M代表映射器,C代表组合器,R代表减速机。但在一般情况下,您的查询可能同时在mapper和reducer上运行

Elapsed: 35sec  
Diagnostics: 
 Average Map Time: 12sec  
 Average Shuffle Time: 10sec  
 Average Merge Time: 0sec  
 Average Reduce Time: 2sec 
 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - detailed locations: M: Alias1[73,14] C: Alias2[20, 9] R: Alias3[90, 78]