Hive 配置单元:如何消除重复的子字符串
配置单元表:Hive 配置单元:如何消除重复的子字符串,hive,duplicates,hiveql,Hive,Duplicates,Hiveql,配置单元表: create table T (i int, s string); insert into T values (1, "a1&b2"), (1, "b2&c3"), (2, "c1&d2"), (2, "c1"); s列包含以分隔的值& 所需的输出应按第1列分组并连接s列,但只有一个唯一的子字符串值(用&)分隔): 以下是我的尝试: SELECT i, concat_ws('&', collect_set( spli
create table T (i int, s string);
insert into T values
(1, "a1&b2"),
(1, "b2&c3"),
(2, "c1&d2"),
(2, "c1");
s列包含以分隔的值&
所需的输出应按第1列分组并连接s列,但只有一个唯一的子字符串值(用&)分隔):
以下是我的尝试:
SELECT i,
concat_ws('&',
collect_set(
split(concat_ws('&' , collect_set(s)), "&" )
)
)
as grouped_s
FROM T group by i;
我明白了:
FAILED: SemanticException [Error 10128]: Line 6:24 Not yet supported place for UDAF 'collect_set'
另外,我希望在不使用嵌套SQL的情况下实现它 使用:
结果:
t.i grouped_s
1 a1&b2&c3
2 c1&d2
select t.i, concat_ws('&',collect_set(e.val)) as grouped_s
from T t
lateral view outer explode(split(t.s,'&')) e as val
group by t.i;
t.i grouped_s
1 a1&b2&c3
2 c1&d2