elasticsearch Elasticsearch ngram标记器返回所有结果,而不考虑查询输入,elasticsearch,nest,elasticsearch-6,elasticsearch,Nest,Elasticsearch 6" /> elasticsearch Elasticsearch ngram标记器返回所有结果,而不考虑查询输入,elasticsearch,nest,elasticsearch-6,elasticsearch,Nest,Elasticsearch 6" />

elasticsearch Elasticsearch ngram标记器返回所有结果,而不考虑查询输入

elasticsearch Elasticsearch ngram标记器返回所有结果,而不考虑查询输入,elasticsearch,nest,elasticsearch-6,elasticsearch,Nest,Elasticsearch 6,我正在尝试构建一个查询,以搜索以下格式的记录:TR000002\u 1\u 2020 用户应能够通过以下方式搜索结果: TR000002或2\u 1\u 2020或TR000002\u 1\u 2020或2020。我认为ngram标记化查询最适合我的需要。我使用的是Elasticsearch 6.8,因此我无法使用E7中引入的内置搜索 这是我在文档中遵循的实现。我唯一修改的是EdgeGram->NGram,因为用户可以从文本的任何点进行搜索 我的分析块如下所示: .Analysis(a =>

我正在尝试构建一个查询,以搜索以下格式的记录:
TR000002\u 1\u 2020

用户应能够通过以下方式搜索结果:

TR000002
2\u 1\u 2020
TR000002\u 1\u 2020
2020
。我认为ngram标记化查询最适合我的需要。我使用的是Elasticsearch 6.8,因此我无法使用E7中引入的内置搜索

这是我在文档中遵循的实现。我唯一修改的是EdgeGram->NGram,因为用户可以从文本的任何点进行搜索

我的分析块如下所示:

.Analysis(a => a
    .Analyzers(aa => aa
        .Custom("autocomplete", ca => ca
            .Tokenizer("autocomplete")
            .Filters(new string[] {
                "lowercase"
            })
        )
        .Custom("autocomplete_search", ca => ca
            .Tokenizer("lowercase")
        )
    )
    .Tokenizers(t => t
        .NGram("autocomplete", e => e
            .MinGram(2)
            .MaxGram(16)
            .TokenChars(new TokenChar[] {
                TokenChar.Letter,
                TokenChar.Digit,
                TokenChar.Punctuation,
                TokenChar.Symbol
            })
        )
    )
)
然后在映射中,我定义:

.Text(t => t
    .Name(tr => tr.TestRecordId)
    .Analyzer("autocomplete")
    .SearchAnalyzer("autocomplete_search")
)
当我搜索
TR000002
时,我的查询返回所有结果,而不仅仅是包含这些特定字符的记录。我做错了什么?对于这个特定用例有更好的标记器吗?谢谢

编辑:以下是返回内容的示例:

{
  "took" : 5,
  "timed_out" : false,
  "_shards" : {
    "total" : 5,
    "successful" : 5,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : 27,
    "max_score" : 0.105360515,
    "hits" : [
      {
        "_index" : "test-records-development-09-09-2020-02-00-00",
        "_type" : "testrecorddto",
        "_id" : "3",
        "_score" : 0.105360515,
        "_source" : {
          "id" : 3,
          "testRecordId" : "TR000002_1_2020",
          "type" : 0,
          "typeName" : "TIDCo60",
          "missionId" : 1,
          "mission" : {
            "missionId" : 1,
            "name" : "[REDACTED]",
            "mRPLUsername" : "[REDACTED]",
            "missionRadiationPartsLead" : {
              "username" : "[REDACTED]",
              "displayName" : "[REDACTED]"
            },
            "missionInstruments" : [
              {
                "missionId" : 1,
                "instrumentId" : 1,
                "cognizantEngineerUsername" : "[REDACTED]",
                "instrument" : {
                  "intstrumentId" : 1,
                  "name" : "Instrument"
                },
                "cognizantEngineer" : {
                  "username" : "[REDACTED]",
                  "displayName" : "[REDACTED]"
                }
              },
              {
                "missionId" : 1,
                "instrumentId" : 2,
                "instrument" : {
                  "intstrumentId" : 2,
                  "name" : "Instrument 2"
                }
              }
            ]
          },
          "procurementPartId" : 2,
          "procurementPart" : {
            "procurementPartId" : 2,
            "partNumber" : "procurement part",
            "part" : {
              "partId" : 1,
              "manufacturer" : "Texas Instruments",
              "genericPartNumber" : "123",
              "description" : "description",
              "partTechnology" : "Part Tech"
            }
          },
          "testStatusId" : 12,
          "testStatus" : {
            "testStatusId" : 12,
            "name" : "Complete: Postponed Until Further Notice"
          },
          "discriminator" : "SingleEventEffectsRecord",
          "testRecordServiceOrders" : [
            {
              "testRecordId" : 3,
              "serviceOrderId" : 9,
              "serviceOrder" : {
                "serviceOrderId" : 9,
                "serviceOrderNumber" : "105702"
              }
            }
          ],
          "rtdbFiles" : [ ],
          "personnelGroups" : [
            {
              "personnelGroupUsers" : [ ]
            },
            {
              "personnelGroupUsers" : [ ]
            }
          ],
          "testRecordTestSubTypes" : [ ],
          "testRecordTestFacilityConditions" : [ ],
          "testRecordFollowers" : [ ],
          "isDeleted" : false,
          "sEETestRates" : [ ]
        }
      },
      {
        "_index" : "test-records-development-09-09-2020-02-00-00",
        "_type" : "testrecorddto",
        "_id" : "11",
        "_score" : 0.105360515,
        "_source" : {
          "id" : 11,
          "testRecordId" : "TR000011_1_2020",
          "type" : 0,
          "typeName" : "TIDCo60",
          "missionId" : 1,
          "mission" : {
            "missionId" : 1,
            "name" : "[REDACTED]",
            "mRPLUsername" : "[REDACTED]",
            "missionRadiationPartsLead" : {
              "username" : "[REDACTED]",
              "displayName" : "[REDACTED]"
            },
            "missionInstruments" : [
              {
                "missionId" : 1,
                "instrumentId" : 1,
                "cognizantEngineerUsername" : "[REDACTED]",
                "instrument" : {
                  "intstrumentId" : 1,
                  "name" : "Instrument"
                },
                "cognizantEngineer" : {
                  "username" : "[REDACTED]",
                  "displayName" : "[REDACTED]"
                }
              },
              {
                "missionId" : 1,
                "instrumentId" : 2,
                "instrument" : {
                  "intstrumentId" : 2,
                  "name" : "Instrument 2"
                }
              }
            ]
          },
          "procurementPartId" : 2,
          "procurementPart" : {
            "procurementPartId" : 2,
            "partNumber" : "procurement part",
            "part" : {
              "partId" : 1,
              "manufacturer" : "Texas Instruments",
              "genericPartNumber" : "123",
              "description" : "description",
              "partTechnology" : "Part Tech"
            }
          },
          "testStatusId" : 1,
          "testStatus" : {
            "testStatusId" : 1,
            "name" : "Active"
          },
          "discriminator" : "TotalIonizingDoseRecord",
          "creatorUsername" : "[REDACTED]",
          "creator" : {
            "username" : "[REDACTED]",
            "displayName" : "[REDACTED]"
          },
          "testRecordServiceOrders" : [ ],
          "partLDC" : "12",
          "waferLot" : "1",
          "rtdbFiles" : [ ],
          "personnelGroups" : [
            {
              "personnelGroupUsers" : [ ]
            }
          ],
          "testRecordTestSubTypes" : [ ],
          "testRecordTestFacilityConditions" : [ ],
          "testRecordFollowers" : [ ],
          "isDeleted" : false,
          "testStartDate" : "2020-07-30T00:00:00",
          "actualCompletionDate" : "2020-07-31T00:00:00"
        }
      },
      {
        "_index" : "test-records-development-09-09-2020-02-00-00",
        "_type" : "testrecorddto",
        "_id" : "17",
        "_score" : 0.105360515,
        "_source" : {
          "id" : 17,
          "testRecordId" : "TR000017_1_2020",
          "type" : 0,
          "typeName" : "TIDCo60",
          "missionId" : 1,
          "mission" : {
            "missionId" : 1,
            "name" : "[REDACTED]",
            "mRPLUsername" : "[REDACTED]",
            "missionRadiationPartsLead" : {
              "username" : "[REDACTED]",
              "displayName" : "[REDACTED]"
            },
            "missionInstruments" : [
              {
                "missionId" : 1,
                "instrumentId" : 1,
                "cognizantEngineerUsername" : "[REDACTED]",
                "instrument" : {
                  "intstrumentId" : 1,
                  "name" : "Instrument"
                },
                "cognizantEngineer" : {
                  "username" : "lewallen",
                  "displayName" : "[REDACTED]"
                }
              },
              {
                "missionId" : 1,
                "instrumentId" : 2,
                "instrument" : {
                  "intstrumentId" : 2,
                  "name" : "Instrument 2"
                }
              }
            ]
          },
          "procurementPartId" : 2,
          "procurementPart" : {
            "procurementPartId" : 2,
            "partNumber" : "procurement part",
            "part" : {
              "partId" : 1,
              "manufacturer" : "Texas Instruments",
              "genericPartNumber" : "123",
              "description" : "description",
              "partTechnology" : "Part Tech"
            }
          },
          "testStatusId" : 1,
          "testStatus" : {
            "testStatusId" : 1,
            "name" : "Active"
          },
          "discriminator" : "TotalIonizingDoseRecord",
          "creatorUsername" : "[REDACTED]",
          "creator" : {
            "username" : "[REDACTED]",
            "displayName" : "[REDACTED]"
          },
          "testRecordServiceOrders" : [ ],
          "rtdbFiles" : [ ],
          "personnelGroups" : [
            {
              "personnelGroupUsers" : [ ]
            }
          ],
          "testRecordTestSubTypes" : [ ],
          "testRecordTestFacilityConditions" : [ ],
          "testRecordFollowers" : [ ],
          "isDeleted" : false
        }
      },
以下是
映射的显示内容

"testRecordId" : {
  "type" : "text",
  "analyzer" : "autocomplete",
  "search_analyzer" : "autocomplete_search"
},
我想我还应该提到,我一直在控制台中测试这个查询,如下所示:

GET test-records-development/_search
{
  "query": {
    "match": {
      "testRecordId": {
        "query": "TR000002_1_2020"
      }
    }
  }
}
编辑2:添加了来自索引
\u设置
端点的API响应:

{
  "test-records-development-09-09-2020-02-00-00" : {
    "settings" : {
      "index" : {
        "number_of_shards" : "5",
        "provided_name" : "test-records-development-09-09-2020-02-00-00",
        "creation_date" : "1599617013874",
        "analysis" : {
          "analyzer" : {
            "autocomplete" : {
              "filter" : [
                "lowercase"
              ],
              "type" : "custom",
              "tokenizer" : "autocomplete"
            },
            "autocomplete_search" : {
              "type" : "custom",
              "tokenizer" : "lowercase"
            }
          },
          "tokenizer" : {
            "autocomplete" : {
              "token_chars" : [
                "letter",
                "digit",
                "punctuation",
                "symbol"
              ],
              "min_gram" : "2",
              "type" : "ngram",
              "max_gram" : "16"
            }
          }
        },
        "number_of_replicas" : "0",
        "uuid" : "FSeCa0YwRCOJVbjfxYGkig",
        "version" : {
          "created" : "6080199"
        }
      }
    }
  }
}

由于analyzer没有设置JSON格式的访问权限,我无法确认,但最可能的问题是您的搜索分析器
autocomplete\u search
正在创建与索引时间标记匹配的搜索时间标记

例如:您正在搜索
TR000002_1_2020
,如果它创建
2020
作为标记,并且对于包含
TR000011_1_2020
的文档,也会创建一个
2020
标记,而您的查询将与之匹配


您可以使用来检查基于分析器生成的令牌,如前所述,大部分令牌是匹配的,如上图所示。

如果您说返回所有结果,您可以更具体一些,您应该在结果中提供一些示例文档、预期文档和当前文档,我已经多次使用过这个查询,它是有效的。@OpsterElasticsearchNinja添加了一个编辑,向您显示返回的数据样本(27个中的3个)。
testRecordId
属性很重要。我还添加了
index/_映射
GET来显示它正在使用分析器。我还能为您提供什么帮助?谢谢编辑:还添加了我如何使用kibana控制台测试结果,非常清楚,我知道为什么会出现这个问题,但要确认,我需要查看JSON格式的索引设置,您可以使用设置API来提供吗?@opterElasticSearchNinja我添加了一个编辑来显示
\u设置
响应,如果有帮助的话。到目前为止非常感谢:)是的,根据
analyze
API,这正是正在发生的事情!根据您的经验,对于这样的搜索场景,您倾向于使用什么方法?我是否必须将结果转换为通配符?使用通配符是我的第一次尝试,但由于通配符查询的大小写敏感,所以我遇到了一些问题keyword@JordanLewallen这是后续问题,您已经测试了analyzer API的O/P,并确认这是由于analyzer的不正确使用造成的,我希望你能投票,接受答案,并提出一个新的问题,这个问题集中在搜索用例上,这样一来,这两篇文章都会有重点,对社区有帮助:)@JordanLewallen也请在你有了新问题的链接后马上打电话给我,我会尽快为你提供有效的解决方案:)好的观点,在这里创建了一个新问题:将此问题标记为正确!非常感谢迄今为止的帮助