如何在HBASE中存储猪袋?
我试图做的是在如何在HBASE中存储猪袋?,hbase,apache-pig,Hbase,Apache Pig,我试图做的是在PIG 因此,我基本上做了以下工作: //Loading some address data CITY = LOAD '/user/root/landingzone/ADRPCDCITY.csv' using PigStorage(';') AS (dPOST_CODE:chararray, dCITY_CODE:chararray); //Create the BAG by grouping postal code B = GROUP CITY by dPOST_CODE;
PIG
因此,我基本上做了以下工作:
//Loading some address data
CITY = LOAD '/user/root/landingzone/ADRPCDCITY.csv' using PigStorage(';')
AS (dPOST_CODE:chararray, dCITY_CODE:chararray);
//Create the BAG by grouping postal code
B = GROUP CITY by dPOST_CODE;
//Store it in HBASE
STORE B INTO 'hbase://TEST_ADDRESS_VALIDATION'
USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
'f1: group, f1:CITY' );
我面临的问题是,BAG
不能被铸造到HBASE
Map类
java.lang.ClassCastException: org.apache.pig.data.InternalCachedBag cannot be cast to java.util.Map
非常感谢你的帮助 更好
我得到了一个解决方案,我想与大家分享
CITY = LOAD '/user/root/landingzone/CITY_Test.csv' using PigStorage(';')
AS (POST_CODE:chararray, CITY_CODE:long, CITY_NAME:chararray);
A = FILTER CITY BY (POST_CODE) IS NOT NULL;
result = FOREACH A GENERATE POST_CODE, TOMAP(UPPER(CITY_NAME), CITY_CODE);
STORE result INTO 'CITY_ADDRESS_VALIDATION' USING org.apache.pig.backend.hadoop.hbase.HBaseStorage( 'f1' );
使用TOMAP并通过hbastorage保存它,但不在那里分配映射,这样做很有效。您能提供属于异常的堆栈跟踪吗?