Python NLTK所有可能的pos标签是什么?

Python NLTK所有可能的pos标签是什么?,python,nltk,Python,Nltk,如何查找包含自然语言工具包(nltk)使用的所有可能pos标记的列表?有一个关于如何查找标记集帮助的说明,例如: nltk.help.upenn_tagset() 其他人可能也类似。(注意:可能您首先必须从下载助手的模型部分下载标记集)标记集取决于用于训练标记者的语料库。 nltk.pos_tag()的默认标记器使用 在NLTK 2中,您可以检查哪个标记器是默认标记器,如下所示: import nltk nltk.tag._POS_TAGGER >>> 'taggers/ma

如何查找包含自然语言工具包(nltk)使用的所有可能pos标记的列表?

有一个关于如何查找标记集帮助的说明,例如:

nltk.help.upenn_tagset()

其他人可能也类似。(注意:可能您首先必须从下载助手的模型部分下载标记集)

标记集取决于用于训练标记者的语料库。
nltk.pos_tag()
的默认标记器使用

在NLTK 2中,您可以检查哪个标记器是默认标记器,如下所示:

import nltk
nltk.tag._POS_TAGGER
>>> 'taggers/maxent_treebank_pos_tagger/english.pickle'
这意味着它是在树库语料库上训练的最大熵标记器


nltk.tag.\u POS\u TAGGER
在nltk 3中不再存在,但现成的TAGGER仍然使用Penn Treebank标记集

以下内容可用于访问由缩写键入的dict:

>>> from nltk.data import load
>>> tagdict = load('help/tagsets/upenn_tagset.pickle')
>>> tagdict['NN'][0]
'noun, common, singular or mass'
>>> tagdict.keys()
['PRP$', 'VBG', 'VBD', '``', 'VBN', ',', "''", 'VBP', 'WDT', ...

为了节省一些人的时间,下面是我从一个小语料库中提取的一个列表。我不知道它是否完整,但它应该包含来自upenn_标记集的大部分(如果不是全部)帮助定义

CC:连词,协调词

& 'n and both but either et for less minus neither nor or plus so
therefore times v. versus vs. whether yet
astride among uppon whether out inside pro despite on by throughout
below within for towards near behind atop around if like until below
next into if beside ...
CD:数字,基数

mid-1890 nine-thirty forty-two one-tenth ten million 0.5 one forty-
seven 1987 twenty '79 zero two 78-degrees eighty-four IX '60s .025
fifteen 271,124 dozen quintillion DM2,000 ...
DT:限定符

all an another any both del each either every half la many much nary
neither no some such that the them these this those
all both half many quite such sure this
that what whatever which whichever
EX:存在于那里

there
中的:介词或连词,从属

& 'n and both but either et for less minus neither nor or plus so
therefore times v. versus vs. whether yet
astride among uppon whether out inside pro despite on by throughout
below within for towards near behind atop around if like until below
next into if beside ...
JJ:形容词或数字,序数

third ill-mannered pre-war regrettable oiled calamitous first separable
ectoplasmic battery-powered participatory fourth still-to-be-named
multilingual multi-disciplinary ...
JJR:形容词,比较级

bleaker braver breezier briefer brighter brisker broader bumper busier
calmer cheaper choosier cleaner clearer closer colder commoner costlier
cozier creamier crunchier cuter ...
further gloomier grander graver greater grimmer harder harsher
healthier heavier higher however larger later leaner lengthier less-
perfectly lesser lonelier longer louder lower more ...
JJS:形容词,最高级

calmest cheapest choicest classiest cleanest clearest closest commonest
corniest costliest crassest creepiest crudest cutest darkest deadliest
dearest deepest densest dinkiest ...
best biggest bluntest earliest farthest first furthest hardest
heartiest highest largest least less most nearest second tightest worst
LS:列表项标记

A A. B B. C C. D E F First G H I J K One SP-44001 SP-44002 SP-44005
SP-44007 Second Third Three Two * a b c d first five four one six three
two
MD:模态辅助

can cannot could couldn't dare may might must need ought shall should
shouldn't will would
NN:名词、普通、单数或质量

common-carrier cabbage knuckle-duster Casino afghan shed thermostat
investment slide humour falloff slick wind hyena override subhumanity
machinist ...
NNP:名词,专有,单数

Motown Venneboerger Czestochwa Ranzer Conchita Trumplane Christos
Oceanside Escobar Kreisler Sawyer Cougar Yvette Ervin ODI Darryl CTCA
Shannon A.K.C. Meltex Liverpool ...
NNS:名词,普通,复数

undergraduates scotches bric-a-brac products bodyguards facets coasts
divestitures storehouses designs clubs fragrances averages
subjectivists apprehensions muses factory-jobs ...
PDT:预确定器

all an another any both del each either every half la many much nary
neither no some such that the them these this those
all both half many quite such sure this
that what whatever which whichever
位置:属格标记

' 's
to
PRP:代词,人称

hers herself him himself hisself it itself me myself one oneself ours
ourselves ownself self she thee theirs them themselves they thou thy us
PRP$:代词,所有格

her his mine my our ours their thy your
RB:副词

occasionally unabatingly maddeningly adventurously professedly
stirringly prominently technologically magisterially predominately
swiftly fiscally pitilessly ...
RBR:副词,比较级

bleaker braver breezier briefer brighter brisker broader bumper busier
calmer cheaper choosier cleaner clearer closer colder commoner costlier
cozier creamier crunchier cuter ...
further gloomier grander graver greater grimmer harder harsher
healthier heavier higher however larger later leaner lengthier less-
perfectly lesser lonelier longer louder lower more ...
RBS:副词,最高级

calmest cheapest choicest classiest cleanest clearest closest commonest
corniest costliest crassest creepiest crudest cutest darkest deadliest
dearest deepest densest dinkiest ...
best biggest bluntest earliest farthest first furthest hardest
heartiest highest largest least less most nearest second tightest worst
RP:粒子

aboard about across along apart around aside at away back before behind
by crop down ever fast for forth from go high i.e. in into just later
low more off on open out over per pie raising start teeth that through
under unto up up-pp upon whole with you
TO:“TO”作为介词或不定式标记

' 's
to
:感叹词

Goodbye Goody Gosh Wow Jeepers Jee-sus Hubba Hey Kee-reist Oops amen
huh howdy uh dammit whammo shucks heck anyways whodunnit honey golly
man baby diddle hush sonuvabitch ...
VB:动词,基本形式

ask assemble assess assign assume atone attention avoid bake balkanize
bank begin behold believe bend benefit bevel beware bless boil bomb
boost brace break bring broil brush build ...
VBD:动词,过去时

dipped pleaded swiped regummed soaked tidied convened halted registered
cushioned exacted snubbed strode aimed adopted belied figgered
speculated wore appreciated contemplated ...
VBG:动词、现在分词或动名词

telegraphing stirring focusing angering judging stalling lactating
hankerin' alleging veering capping approaching traveling besieging
encrypting interrupting erasing wincing ...
VBN:动词,过去分词

multihulled dilapidated aerosolized chaired languished panelized used
experimented flourished imitated reunifed factored condensed sheared
unsettled primed dubbed desired ...
VBP:动词,现在时,非第三人称单数

predominate wrap resort sue twist spill cure lengthen brush terminate
appear tend stray glisten obtain comprise detest tease attract
emphasize mold postpone sever return wag ...
bases reconstructs marks mixes displeases seals carps weaves snatches
slumps stretches authorizes smolders pictures emerges stockpiles
seduces fizzes uses bolsters slaps speaks pleads ...
VBZ:动词,现在时,第三人称单数

predominate wrap resort sue twist spill cure lengthen brush terminate
appear tend stray glisten obtain comprise detest tease attract
emphasize mold postpone sever return wag ...
bases reconstructs marks mixes displeases seals carps weaves snatches
slumps stretches authorizes smolders pictures emerges stockpiles
seduces fizzes uses bolsters slaps speaks pleads ...
WDT:WH限定词

all an another any both del each either every half la many much nary
neither no some such that the them these this those
all both half many quite such sure this
that what whatever which whichever
WP:WH代词

that what whatever whatsoever which who whom whosoever
WRB:Wh副词

how however whence whenever where whereby whereever wherein whereof why

参考资料可在

从那里复制和粘贴:

  • CC |协调连接|
  • CD |基数|
  • DT |限定符|
  • 这里是存在的|
  • FW |外来词|
  • 介词或从属连词|
  • JJ |形容词|
  • 形容词,比较级|
  • 形容词,最高级|
  • LS |列表项标记|
  • MD |模态|
  • NN |名词,单数或质量|
  • NNS |名词,复数|
  • NNP |专有名词,单数|
  • NNPS |专有名词,复数|
  • PDT |预先决定者|
  • POS |所有格结尾|
  • PRP |人称代词|
  • PRP$|所有格代词|
  • RB |副词|
  • 比较副词|
  • RBS |副词,最高级|
  • RP |粒子|
  • 符号|
  • 至|至|
  • 呃|叹词|
  • VB |动词,基本形式|
  • VBD |动词,过去时|
  • VBG |动词、动名词或现在分词|
  • 动词,过去分词|
  • VBP |动词,非第三人称单数出现|
  • VBZ |动词,第三人称单数出现|
  • WDT | Wh限定词|
  • WP | Wh代词|
  • WP$|所有格wh代词|
  • WRB | Wh副词|

您可以在此处下载列表:。它包括令人困惑的词类、大写和其他约定。还有一个类似的有趣部分。部分:使用的词性标记

请逐字逐句地运行此命令

import nltk
nltk.download('tagsets')
nltk.help.upenn_tagset()
nltk.tag.\u POS\u TAGGER
不起作用。它将给出属性错误:模块“nltk.tag”没有属性“\u POS\u TAGGER”
。它在NLTK 3中不再可用

['LS', 'TO', 'VBN', "''", 'WP', 'UH', 'VBG', 'JJ', 'VBZ', '--', 'VBP', 'NN', 'DT', 'PRP', ':', 'WP$', 'NNPS', 'PRP$', 'WDT', '(', ')', '.', ',', '``', '$', 'RB', 'RBR', 'RBS', 'VBD', 'IN', 'FW', 'RP', 'JJR', 'JJS', 'PDT', 'MD', 'VB', 'WRB', 'NNP', 'EX', 'NNS', 'SYM', 'CC', 'CD', 'POS']

基于Doug Shore的方法,但要使其更易于复制粘贴

谢谢你,在我看来,这是一个比公认的答案更有用的答案。这是一个不完整的答案。首先,
nltk.tag.\u POS\u TAGGER
不会执行,也没有提供有关导入内容的具体说明。此外,找出正在使用的标记器是答案的一半,问题是要得到标记器中所有可能标记的列表。确定标记集的是语料库,而不是标记器。一旦你知道了语料库的名称,整个标签集就只需要谷歌搜索了。现在我很好奇:这有什么神秘的?我从来没有真正使用过NLTK,找到这个答案花了我五分钟的时间在谷歌上搜索。。。它真的那么隐蔽吗?我想这不是如何隐藏的问题,我只是想标记一个句子,因为我正在寻找nltk将我的动词标记为名词的原因,我不知道如何使用不同的标记集。这也很有帮助,谢谢@如果别人像我一样,我的期望是错误的。我希望有一个查找表/列表/地图,将像
RB
这样的词性首字母缩略词映射到像
副词
这样的词义。(;或参见@Suzana的答案,其中链接了。但是你是对的,内置的
nltk.help.upenn_标记集('RB')
很有帮助,并且在前面提到过,有人计算了有多少标记集吗?我更喜欢这种方法而不是公认的解决方案,因为它更简单,并且可以清楚地枚举可能的值。我们如何确定这是标记集u