Warning: file_get_contents(/data/phpspider/zhask/data//catemap/5/ruby/24.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Apache pig 如何使用ApachePig将avro子字段升级到根字段?_Apache Pig - Fatal编程技术网

Apache pig 如何使用ApachePig将avro子字段升级到根字段?

Apache pig 如何使用ApachePig将avro子字段升级到根字段?,apache-pig,Apache Pig,我有以下avro模式: { "id":1, "subfields": { "field_A":"value_A", "field_B":"value_B", "field_C":["value_C1","value_C2"] }, other_field: "other_field" } 使用Pig,我希望将“子字段”中的所有字段升级到主级别,从而生成的avro为: { "id":1, "field_A":"value_A", "field_B":"value_B", "field_C":["

我有以下avro模式:

{
"id":1,
"subfields": {
"field_A":"value_A",
"field_B":"value_B",
"field_C":["value_C1","value_C2"]
},
other_field: "other_field"
}
使用Pig,我希望将“子字段”中的所有字段升级到主级别,从而生成的avro为:

{
"id":1,
"field_A":"value_A",
"field_B":"value_B",
"field_C":["value_C1","value_C2"]
other_field: "other_field"
}

如何做到这一点?

将数据加载到Pig后,数据的模式是什么?不确定,请使用AvroLoader()将其按原样加载。将数据加载到Pig后,使用
descripe
命令获取模式。