- elasticsearch/
elasticsearch 模糊匹配中模糊参数与编辑距离的弹性搜索不一致性
elasticsearch 模糊匹配中模糊参数与编辑距离的弹性搜索不一致性
我试图理解模糊性在使用span_近于多个子句的模糊搜索中的作用 这里我正在清点文件。这里有一个问题
GET wikipedia-20200820/_search
{
"query":{
"bool":{
"must":[
{
"span_near":{
"clauses":[
{
"span_multi":{
"match":{
"fuzzy":{
"text":{
"value":"labor",
"fuzziness":"2"
}
}
}
}
},
{
"span_multi":{
"match":{
"fuzzy":{
"text":{
"value":"unionism",
"fuzziness":"2"
}
}
}
}
},
{
"span_multi":{
"match":{
"fuzzy":{
"text":{
"value":"among",
"fuzziness":"2"
}
}
}
}
},
{
"span_multi":{
"match":{
"fuzzy":{
"text":{
"value":"negros",
"fuzziness":"2"
}
}
}
}
}
],
"slop":1,
"in_order":true
}
}
],
"filter": [
{ "term": { "ns": 0 }},
{ "range": { "timestamp": { "gte": "2020-01-01" }}}
]
}
}
}
{
"took" : 284,
"timed_out" : false,
"_shards" : {
"total" : 1,
"successful" : 1,
"skipped" : 0,
"failed" : 0
},
"hits" : {
"total" : {
"value" : 1,
"relation" : "eq"
},
"max_score" : 2238.6646,
"hits" : [
{
"_index" : "wikipedia-20200820",
"_type" : "_doc",
"_id" : "GhxaT3UBz_UQYd3DEAJT",
"_score" : 2238.6646,
"_source" : {
"page_title" : "National Brotherhood of Workers of America",
"ns" : 0,
"page_id" : 28365131,
"redirect" : null,
"revision_id" : 965097134,
"revision_parent_id" : 891907364,
"timestamp" : "2020-06-29T11:26:55Z",
"contributor" : {
"username" : "JJMC89 bot III",
"id" : 35936988
},
"comment" : "Moving [[:Category:African-American history between emancipation and the Civil Rights Movement]] to [[:Category:African-American history between emancipation and the civil rights movement]] per [[Wikipedia:Categories for discussion/Speedy]]",
"sha1" : "q1rz1h5n6qk9cpdt5qf0zqrydd9vx7e",
"minor" : "TRUE",
"model" : "wikitext",
"format" : "text/x-wiki",
"text" : """The '''National Brotherhood of Workers of America''' (NBWA) was the largest body of organised [[African American]] workers in the [[United States of America]] in 1919.<ref>''Revolutionary radicalism: its history, purpose and tactics with an exposition and discussion of the steps being taken and required to curb it, being the report of the Joint Legislative Committee Investigating Seditious Activities'', filed 24 April 1920, in the Senate of the State of New York</ref>
==First congress==
The organisation was formed by T.J. Pree and R.T. Sims. [[Philip Randolph]] was also on the board.<ref name=yho>[http://hierographics.org/yourhistoryonline/yourhistoryonlineVIII.htm Your History online], accessed 17 August 2010</ref> The NBWA held its congress in [[Washington DC]] from 8–14 September 1919. There were 115 delegates primarily from the South. Three delegates were from the [[Industrial Workers of the World]] and fifteen from the Society for the Advancement of Trade Unionism among Negroes. No delegates were accepted from the [[American Federation of Labor]].<ref>''Revolutionary radicalism: its history, purpose and tactics with an exposition and discussion of the steps being taken and required to curb it, being the report of the Joint Legislative Committee Investigating Seditious Activities'', filed 24 April 1920, in the Senate of the State of New York</ref>
==Resolutions==
They passed resolutions to the effect that:
". . . The combination of black and white workers will be a powerful lesson to the capitalists of the solidarity of labor. It will show that labor, black and white, is conscious of its interests and power. This will serve to convert a class of worker, which has been used by the capitalist class
to defeat organised labor, into an ardent, class-conscious, intelligent, militant group."
"and be it further resolved, that we recommend to all the working people of our race, that they immediately make themselves acquainted more in detail with the
aims, objects and methods of said organization, the National Association for the Protection of
Labor Unionism Among Negroes, in order that we may, as speedily as possible, align ourselves with and join the industrial unions that have already organized, and help to organize new industrial unions in such industries where they do not yet exist.
"and be it further resolved, that we shall henceforth devote all our energies to building up the new order of society along lines above indicated, to the exclusion of efforts hitherto expended in other directions." <ref>''Revolutionary radicalism: its history, purpose and tactics with an exposition and discussion of the steps being taken and required to curb it, being the report of the Joint Legislative Committee Investigating Seditious Activities'', filed 24 April 1920, in the Senate of the State of New York</ref>
The NBWA functioned as an independent Union, drawing most of its support from shipyard and dock workers in the [[Tidewater region of Virginia]] area.<ref>''Crisis'', November 1951, p626</ref> The union dissolved in 1921, under pressure from the American Federation of Labor.<ref name=yho/>
==References==
{{reflist}}
[[Category:African-American leftism]]
[[Category:African-American history between emancipation and the civil rights movement]]
[[Category:Trade unions established in 1919]]
[[Category:Trade unions disestablished in 1921]]
[[Category:African-American trade unions]]"""
}
}
]
}
}
fuzziness模糊性+----------------+---------------+-----------+---------------+-----------------------------+
| iniatial_query | updated_query | fuzziness | edit_distance | elastic_returns_same_result |
+----------------+---------------+-----------+---------------+-----------------------------+
| "labor" | "labot" | 2 | 1 | Yes |
| "labor" | "labori" | 2 | 1 | No |
| "labor" | "lab" | 2 | 2 | No |
| "labor" | "lab" | 3 | 2 | No |
| "labor" | "lab" | 4 | 2 | No |
| "labor" | " labor" | 2 | 1 (1 space) | Yes |
| "labor" | " labor" | 1 | 1 (1 space) | Yes |
| "labor" | " labor" | 2 | 2 (2 space) | No |
| "unionism" | "unionismi" | 2 | 1 | Yes |
| "unionism" | "unionismi" | 1 | 1 | Yes |
| "among" | "amonng" | 2 | 1 | Yes |
| "among" | "amonng" | 1 | 1 | Yes |
| "among" | "amonnng" | 2 | 2 | No |
| "among" | "amonnng" | 3 | 2 | No |
| "among" | "amonnng" | 10 | 2 | No |
+----------------+---------------+-----------+---------------+-----------------------------+
模糊性参数对查询的影响吗？：
自动的
根据术语的长度生成编辑距离。低矮的
可以选择自动提供远距离参数：[低]，[高]。
如果未指定，默认值为3和6，相当于
自动：3,6表示长度：
0..2必须完全匹配
3..5允许一次编辑
5允许自动进行两次编辑通常应为
模糊性
在问题中，您提到，当更新的_值为lab
时，elasticsearch不会返回与以前相同的结果。但正如你在下面看到的，结果是准确的。这是因为编辑距离为2
lab --> labo --> labor
同样，对于labori
、labor
和amonng
索引数据：
{
"text":"The organisation was formed by T.J. Pree and R.T. Sims. [[Philip Randolph]] was also on the board.<ref name=yho>[http://hierographics.org/yourhistoryonline/yourhistoryonlineVIII.htm Your History online], accessed 17 August 2010</ref> The NBWA held its congress in [[Washington DC]] from 8–14 September 1919. There were 115 delegates primarily from the South. Three delegates were from the [[Industrial Workers of the World]] and fifteen from the Society for the Advancement of Trade Unionism among Negroes. No delegates were accepted from the [[American Federation of Labor]].<ref>''Revolutionary radicalism: its history, purpose and tactics with an exposition and discussion of the steps being taken and required to curb it, being the report of the Joint Legislative Committee Investigating Seditious Activities'', filed 24 April 1920, in the Senate of the State of New York</ref>"
}
{
"query": {
"bool": {
"must": [
{
"span_near": {
"clauses": [
{
"span_multi": {
"match": {
"fuzzy": {
"text": {
"value": "lab", <-- note this
"fuzziness": "2"
}
}
}
}
}
],
"slop": 1,
"in_order": true
}
}
]
}
}
}
"hits": [
{
"_index": "64492853",
"_type": "_doc",
"_id": "1",
"_score": 2.2105305,
"_source": {
"text": "The organisation was formed by T.J. Pree and R.T. Sims. [[Philip Randolph]] was also on the board.<ref name=yho>[http://hierographics.org/yourhistoryonline/yourhistoryonlineVIII.htm Your History online], accessed 17 August 2010</ref> The NBWA held its congress in [[Washington DC]] from 8–14 September 1919. There were 115 delegates primarily from the South. Three delegates were from the [[Industrial Workers of the World]] and fifteen from the Society for the Advancement of Trade Unionism among Negroes. No delegates were accepted from the [[American Federation of Labor]].<ref>''Revolutionary radicalism: its history, purpose and tactics with an exposition and discussion of the steps being taken and required to curb it, being the report of the Joint Legislative Committee Investigating Seditious Activities'', filed 24 April 1920, in the Senate of the State of New York</ref>"
}
}
]
搜索查询：
{
"text":"The organisation was formed by T.J. Pree and R.T. Sims. [[Philip Randolph]] was also on the board.<ref name=yho>[http://hierographics.org/yourhistoryonline/yourhistoryonlineVIII.htm Your History online], accessed 17 August 2010</ref> The NBWA held its congress in [[Washington DC]] from 8–14 September 1919. There were 115 delegates primarily from the South. Three delegates were from the [[Industrial Workers of the World]] and fifteen from the Society for the Advancement of Trade Unionism among Negroes. No delegates were accepted from the [[American Federation of Labor]].<ref>''Revolutionary radicalism: its history, purpose and tactics with an exposition and discussion of the steps being taken and required to curb it, being the report of the Joint Legislative Committee Investigating Seditious Activities'', filed 24 April 1920, in the Senate of the State of New York</ref>"
}
{
"query": {
"bool": {
"must": [
{
"span_near": {
"clauses": [
{
"span_multi": {
"match": {
"fuzzy": {
"text": {
"value": "lab", <-- note this
"fuzziness": "2"
}
}
}
}
}
],
"slop": 1,
"in_order": true
}
}
]
}
}
}
"hits": [
{
"_index": "64492853",
"_type": "_doc",
"_id": "1",
"_score": 2.2105305,
"_source": {
"text": "The organisation was formed by T.J. Pree and R.T. Sims. [[Philip Randolph]] was also on the board.<ref name=yho>[http://hierographics.org/yourhistoryonline/yourhistoryonlineVIII.htm Your History online], accessed 17 August 2010</ref> The NBWA held its congress in [[Washington DC]] from 8–14 September 1919. There were 115 delegates primarily from the South. Three delegates were from the [[Industrial Workers of the World]] and fifteen from the Society for the Advancement of Trade Unionism among Negroes. No delegates were accepted from the [[American Federation of Labor]].<ref>''Revolutionary radicalism: its history, purpose and tactics with an exposition and discussion of the steps being taken and required to curb it, being the report of the Joint Legislative Committee Investigating Seditious Activities'', filed 24 April 1920, in the Senate of the State of New York</ref>"
}
}
]
我在本文档中看到您有labori
，并且amonng
正在按预期返回结果。但是当你尝试一段时间后，它就不起作用了。即使将模糊性参数增加到3、4或5也不起作用。“编辑距离”参数是否可能限制为2个编辑距离？你能解释一下我在原始文档中的查询发生了什么吗？至少为什么labori
和amonng
在我的文本中不起作用？