Java 有效地将不同的可能子字符串匹配到相同的值
我有一个CSV文件,其中一列称为操作系统,包含一个字符串,其值如下所示:Java 有效地将不同的可能子字符串匹配到相同的值,java,python,regex,Java,Python,Regex,我有一个CSV文件,其中一列称为操作系统,包含一个字符串,其值如下所示: win-abc123 def456-windows 123123-WIN-ghi789 rhel-jkl012 45u8234dgf-redhat-mno345 pqr678-RHEL os_map = {frozenset(['win', 'windows', 'WIN']):'WIN', frozenset(['rhel', 'redhat', 'RHEL',]): 'RHEL'} for k, v in os_m
win-abc123
def456-windows
123123-WIN-ghi789
rhel-jkl012
45u8234dgf-redhat-mno345
pqr678-RHEL
os_map = {frozenset(['win', 'windows', 'WIN']):'WIN', frozenset(['rhel', 'redhat', 'RHEL',]): 'RHEL'}
for k, v in os_map.items():
test=re.sub(r'\b({})\b'.format('|'.join(k)), v, test)
for line in test.splitlines():
m=re.search(r'\b({})\b'.format('|'.join(os_map.values())), line)
if m:
print line, m.group(0)
换句话说,列值包含一个子字符串,该子字符串位于表示操作系统的字符串(前、中或后)的某个位置。这些值可以是win
,windows
,win
,rhel
,redhat
,rhel
中的一个
我想检查列值,并用WIN
或RHEL
替换整个列来清理它
我有一个笨拙的解决方案。迭代CSV中的每一行,并迭代操作系统映射中的每一个键、值对。如果匹配,则替换CSV值
os_map = {'win':'WIN', 'windows': 'WIN', 'WIN':'WIN', 'rhel': 'RHEL', 'redhat': 'RHEL', 'RHEL': 'RHEL'}
for row in rows:
os = row[OPERATING_SYSTEM]
for key, value in os_map.iteritems():
if key in os:
row[OPERATING_SYSTEM] = value
break
或者,在java中:
Map<String, String> osMap = new HashMap<String, String>();
osMap.put("win", "WIN");
osMap.put("windows", "WIN");
osMap.put("WIN", "WIN");
// Repeat for RHEL values
String os;
for (String[] row : rows) {
os = row[OPERATING_SYSTEM];
for (Map.Entry<String, String> entry: osMap.entrySet()) {
if (os.contains(entry.getKey())) {
row[OPERATING_SYSTEM] = entry.getValue();
break;
}
}
}
但事实并非如此。在Python中,您可以按照以下思路进行操作:
test='''\
win-abc123
def456-windows
123123-WIN-ghi789
rhel-jkl012
45u8234dgf-redhat-mno345
pqr678-RHEL'''
from itertools import chain
os_map = {frozenset(['win', 'windows', 'WIN']):'WIN', frozenset(['rhel', 'redhat', 'RHEL',]): 'RHEL'}
all_os=set(chain(*os_map.keys()))
for line in test.splitlines():
tgt=filter(lambda e: e in all_os, line.split('-'))
if tgt:
print os_map[filter(lambda k: tgt[0] in k, os_map.keys())[0]]
您还可以对regex进行口述:
import re
os_reg={re.compile(r'\b(win|windows|WIN)\b'):'WIN', re.compile(r'\b(rhel|redhat|RHEL)\b'): 'RHEL'}
for line in test.splitlines():
for pat, v in os_reg.items():
if pat.search(line):
print line, v
break
^.*(win(dows)?|r(hel|edhat)).*$
或者将set和regex组合起来执行以下操作:
win-abc123
def456-windows
123123-WIN-ghi789
rhel-jkl012
45u8234dgf-redhat-mno345
pqr678-RHEL
os_map = {frozenset(['win', 'windows', 'WIN']):'WIN', frozenset(['rhel', 'redhat', 'RHEL',]): 'RHEL'}
for k, v in os_map.items():
test=re.sub(r'\b({})\b'.format('|'.join(k)), v, test)
for line in test.splitlines():
m=re.search(r'\b({})\b'.format('|'.join(os_map.values())), line)
if m:
print line, m.group(0)
最好使用状态机或正则表达式。查看java库中的正则表达式以查找和替换语义。如果你是硬核,你可以扮演自己的状态机角色,这可能是处理搜索部分最有效的方式。更换零件可能有点棘手 为这种类型的字符串替换提供了一些很好的语法。如果您的csv文件非常大,它可能非常适合:
In [76]:
print df
val
0 win-abc123
1 def456-windows
2 123123-WIN-ghi789
3 rhel-jkl012
4 45u8234dgf-redhat-mno345
5 pqr678-RHEL
In [77]:
df['val'] = df.val.str.replace(r'\b(win|windows|WIN)\b', 'WIN')
df['val'] = df.val.str.replace(r'\b(rhel|redhat|RHEL)\b', 'RHEL')
print df
val
0 WIN-abc123
1 def456-WIN
2 123123-WIN-ghi789
3 RHEL-jkl012
4 45u8234dgf-RHEL-mno345
5 pqr678-RHEL
您可以尝试使用不区分大小写的regex版本:
import re
os_reg={re.compile(r'\b(win|windows|WIN)\b'):'WIN', re.compile(r'\b(rhel|redhat|RHEL)\b'): 'RHEL'}
for line in test.splitlines():
for pat, v in os_reg.items():
if pat.search(line):
print line, v
break
^.*(win(dows)?|r(hel|edhat)).*$
Java中的简化示例:
public class Test {
public static void main(String[] args) {
String[] lines = {"win-abc123","def456-windows","123123-WIN-ghi789","rhel-jkl012","45u8234dgf-redhat-mno345","pqr678-RHEL"};
Matcher matcher = Pattern.compile("^.*(win(dows)?|r(hel|edhat)).*$",Pattern.CASE_INSENSITIVE).matcher("");
for(String line : lines){
matcher.reset(line);
if(matcher.matches()){
System.out.println(line);
}
}
}
}