Warning: file_get_contents(/data/phpspider/zhask/data//catemap/3/xpath/2.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
apachebeam和Hive复杂类型_Hive_Apache Beam_Hive Serde - Fatal编程技术网

apachebeam和Hive复杂类型

apachebeam和Hive复杂类型,hive,apache-beam,hive-serde,Hive,Apache Beam,Hive Serde,我有一个配置单元表,它的列类型为mapIt。看起来我们需要更改以将投影下推到HCatalogIO,以便能够跳过映射列,不幸的是,这样的下推可能也不存在。请注意,BeamSQL确实支持映射类型,但问题是通过HCatalog IO读取映射类型。您好,您能否提供任何最新的示例代码,以便从配置单元中读取并将其保存为Pcollection中的行格式?(我查看了ApacheBeam网站示例,但由于某些原因,它不起作用) HCatalogIO.Read hiveIo = HCatalogIO.read()

我有一个配置单元表,它的列类型为
mapIt。看起来我们需要更改以将投影下推到HCatalogIO,以便能够跳过映射列,不幸的是,这样的下推可能也不存在。请注意,BeamSQL确实支持映射类型,但问题是通过HCatalog IO读取映射类型。您好,您能否提供任何最新的示例代码,以便从配置单元中读取并将其保存为Pcollection中的行格式?(我查看了ApacheBeam网站示例,但由于某些原因,它不起作用)
HCatalogIO.Read hiveIo = HCatalogIO.read()
      .withConfigProperties(configProperties)
      .withDatabase("db") 
      .withTable("web_search_log")
      .withFilter("yyyy_mm_dd == '2019-09-01'");
p.apply(HCatToRow.fromSpec(hiveIo))
Exception in thread "main" java.lang.RuntimeException: java.lang.UnsupportedOperationException: The type 'map<string,string>' of field 'price_buckets' is not supported.
at org.apache.beam.sdk.io.hcatalog.HCatalogBeamSchema.getTableSchema(HCatalogBeamSchema.java:88)