elasticsearch Elasticsearch ngram标记器返回所有结果,而不考虑查询输入
我正在尝试构建一个查询,以搜索以下格式的记录:elasticsearch Elasticsearch ngram标记器返回所有结果,而不考虑查询输入,elasticsearch,nest,elasticsearch-6,elasticsearch,Nest,Elasticsearch 6,我正在尝试构建一个查询,以搜索以下格式的记录:TR000002\u 1\u 2020 用户应能够通过以下方式搜索结果: TR000002或2\u 1\u 2020或TR000002\u 1\u 2020或2020。我认为ngram标记化查询最适合我的需要。我使用的是Elasticsearch 6.8,因此我无法使用E7中引入的内置搜索 这是我在文档中遵循的实现。我唯一修改的是EdgeGram->NGram,因为用户可以从文本的任何点进行搜索 我的分析块如下所示: .Analysis(a =>
TR000002\u 1\u 2020
用户应能够通过以下方式搜索结果:
TR000002
或2\u 1\u 2020
或TR000002\u 1\u 2020
或2020
。我认为ngram标记化查询最适合我的需要。我使用的是Elasticsearch 6.8,因此我无法使用E7中引入的内置搜索
这是我在文档中遵循的实现。我唯一修改的是EdgeGram->NGram,因为用户可以从文本的任何点进行搜索
我的分析块如下所示:
.Analysis(a => a
.Analyzers(aa => aa
.Custom("autocomplete", ca => ca
.Tokenizer("autocomplete")
.Filters(new string[] {
"lowercase"
})
)
.Custom("autocomplete_search", ca => ca
.Tokenizer("lowercase")
)
)
.Tokenizers(t => t
.NGram("autocomplete", e => e
.MinGram(2)
.MaxGram(16)
.TokenChars(new TokenChar[] {
TokenChar.Letter,
TokenChar.Digit,
TokenChar.Punctuation,
TokenChar.Symbol
})
)
)
)
然后在映射中,我定义:
.Text(t => t
.Name(tr => tr.TestRecordId)
.Analyzer("autocomplete")
.SearchAnalyzer("autocomplete_search")
)
当我搜索TR000002
时,我的查询返回所有结果,而不仅仅是包含这些特定字符的记录。我做错了什么?对于这个特定用例有更好的标记器吗?谢谢
编辑:以下是返回内容的示例:
{
"took" : 5,
"timed_out" : false,
"_shards" : {
"total" : 5,
"successful" : 5,
"skipped" : 0,
"failed" : 0
},
"hits" : {
"total" : 27,
"max_score" : 0.105360515,
"hits" : [
{
"_index" : "test-records-development-09-09-2020-02-00-00",
"_type" : "testrecorddto",
"_id" : "3",
"_score" : 0.105360515,
"_source" : {
"id" : 3,
"testRecordId" : "TR000002_1_2020",
"type" : 0,
"typeName" : "TIDCo60",
"missionId" : 1,
"mission" : {
"missionId" : 1,
"name" : "[REDACTED]",
"mRPLUsername" : "[REDACTED]",
"missionRadiationPartsLead" : {
"username" : "[REDACTED]",
"displayName" : "[REDACTED]"
},
"missionInstruments" : [
{
"missionId" : 1,
"instrumentId" : 1,
"cognizantEngineerUsername" : "[REDACTED]",
"instrument" : {
"intstrumentId" : 1,
"name" : "Instrument"
},
"cognizantEngineer" : {
"username" : "[REDACTED]",
"displayName" : "[REDACTED]"
}
},
{
"missionId" : 1,
"instrumentId" : 2,
"instrument" : {
"intstrumentId" : 2,
"name" : "Instrument 2"
}
}
]
},
"procurementPartId" : 2,
"procurementPart" : {
"procurementPartId" : 2,
"partNumber" : "procurement part",
"part" : {
"partId" : 1,
"manufacturer" : "Texas Instruments",
"genericPartNumber" : "123",
"description" : "description",
"partTechnology" : "Part Tech"
}
},
"testStatusId" : 12,
"testStatus" : {
"testStatusId" : 12,
"name" : "Complete: Postponed Until Further Notice"
},
"discriminator" : "SingleEventEffectsRecord",
"testRecordServiceOrders" : [
{
"testRecordId" : 3,
"serviceOrderId" : 9,
"serviceOrder" : {
"serviceOrderId" : 9,
"serviceOrderNumber" : "105702"
}
}
],
"rtdbFiles" : [ ],
"personnelGroups" : [
{
"personnelGroupUsers" : [ ]
},
{
"personnelGroupUsers" : [ ]
}
],
"testRecordTestSubTypes" : [ ],
"testRecordTestFacilityConditions" : [ ],
"testRecordFollowers" : [ ],
"isDeleted" : false,
"sEETestRates" : [ ]
}
},
{
"_index" : "test-records-development-09-09-2020-02-00-00",
"_type" : "testrecorddto",
"_id" : "11",
"_score" : 0.105360515,
"_source" : {
"id" : 11,
"testRecordId" : "TR000011_1_2020",
"type" : 0,
"typeName" : "TIDCo60",
"missionId" : 1,
"mission" : {
"missionId" : 1,
"name" : "[REDACTED]",
"mRPLUsername" : "[REDACTED]",
"missionRadiationPartsLead" : {
"username" : "[REDACTED]",
"displayName" : "[REDACTED]"
},
"missionInstruments" : [
{
"missionId" : 1,
"instrumentId" : 1,
"cognizantEngineerUsername" : "[REDACTED]",
"instrument" : {
"intstrumentId" : 1,
"name" : "Instrument"
},
"cognizantEngineer" : {
"username" : "[REDACTED]",
"displayName" : "[REDACTED]"
}
},
{
"missionId" : 1,
"instrumentId" : 2,
"instrument" : {
"intstrumentId" : 2,
"name" : "Instrument 2"
}
}
]
},
"procurementPartId" : 2,
"procurementPart" : {
"procurementPartId" : 2,
"partNumber" : "procurement part",
"part" : {
"partId" : 1,
"manufacturer" : "Texas Instruments",
"genericPartNumber" : "123",
"description" : "description",
"partTechnology" : "Part Tech"
}
},
"testStatusId" : 1,
"testStatus" : {
"testStatusId" : 1,
"name" : "Active"
},
"discriminator" : "TotalIonizingDoseRecord",
"creatorUsername" : "[REDACTED]",
"creator" : {
"username" : "[REDACTED]",
"displayName" : "[REDACTED]"
},
"testRecordServiceOrders" : [ ],
"partLDC" : "12",
"waferLot" : "1",
"rtdbFiles" : [ ],
"personnelGroups" : [
{
"personnelGroupUsers" : [ ]
}
],
"testRecordTestSubTypes" : [ ],
"testRecordTestFacilityConditions" : [ ],
"testRecordFollowers" : [ ],
"isDeleted" : false,
"testStartDate" : "2020-07-30T00:00:00",
"actualCompletionDate" : "2020-07-31T00:00:00"
}
},
{
"_index" : "test-records-development-09-09-2020-02-00-00",
"_type" : "testrecorddto",
"_id" : "17",
"_score" : 0.105360515,
"_source" : {
"id" : 17,
"testRecordId" : "TR000017_1_2020",
"type" : 0,
"typeName" : "TIDCo60",
"missionId" : 1,
"mission" : {
"missionId" : 1,
"name" : "[REDACTED]",
"mRPLUsername" : "[REDACTED]",
"missionRadiationPartsLead" : {
"username" : "[REDACTED]",
"displayName" : "[REDACTED]"
},
"missionInstruments" : [
{
"missionId" : 1,
"instrumentId" : 1,
"cognizantEngineerUsername" : "[REDACTED]",
"instrument" : {
"intstrumentId" : 1,
"name" : "Instrument"
},
"cognizantEngineer" : {
"username" : "lewallen",
"displayName" : "[REDACTED]"
}
},
{
"missionId" : 1,
"instrumentId" : 2,
"instrument" : {
"intstrumentId" : 2,
"name" : "Instrument 2"
}
}
]
},
"procurementPartId" : 2,
"procurementPart" : {
"procurementPartId" : 2,
"partNumber" : "procurement part",
"part" : {
"partId" : 1,
"manufacturer" : "Texas Instruments",
"genericPartNumber" : "123",
"description" : "description",
"partTechnology" : "Part Tech"
}
},
"testStatusId" : 1,
"testStatus" : {
"testStatusId" : 1,
"name" : "Active"
},
"discriminator" : "TotalIonizingDoseRecord",
"creatorUsername" : "[REDACTED]",
"creator" : {
"username" : "[REDACTED]",
"displayName" : "[REDACTED]"
},
"testRecordServiceOrders" : [ ],
"rtdbFiles" : [ ],
"personnelGroups" : [
{
"personnelGroupUsers" : [ ]
}
],
"testRecordTestSubTypes" : [ ],
"testRecordTestFacilityConditions" : [ ],
"testRecordFollowers" : [ ],
"isDeleted" : false
}
},
以下是映射的显示内容
:
"testRecordId" : {
"type" : "text",
"analyzer" : "autocomplete",
"search_analyzer" : "autocomplete_search"
},
我想我还应该提到,我一直在控制台中测试这个查询,如下所示:
GET test-records-development/_search
{
"query": {
"match": {
"testRecordId": {
"query": "TR000002_1_2020"
}
}
}
}
编辑2:添加了来自索引\u设置端点的API响应:
{
"test-records-development-09-09-2020-02-00-00" : {
"settings" : {
"index" : {
"number_of_shards" : "5",
"provided_name" : "test-records-development-09-09-2020-02-00-00",
"creation_date" : "1599617013874",
"analysis" : {
"analyzer" : {
"autocomplete" : {
"filter" : [
"lowercase"
],
"type" : "custom",
"tokenizer" : "autocomplete"
},
"autocomplete_search" : {
"type" : "custom",
"tokenizer" : "lowercase"
}
},
"tokenizer" : {
"autocomplete" : {
"token_chars" : [
"letter",
"digit",
"punctuation",
"symbol"
],
"min_gram" : "2",
"type" : "ngram",
"max_gram" : "16"
}
}
},
"number_of_replicas" : "0",
"uuid" : "FSeCa0YwRCOJVbjfxYGkig",
"version" : {
"created" : "6080199"
}
}
}
}
}
由于analyzer没有设置JSON格式的访问权限,我无法确认,但最可能的问题是您的搜索分析器autocomplete\u search
正在创建与索引时间标记匹配的搜索时间标记
例如:您正在搜索TR000002_1_2020
,如果它创建2020
作为标记,并且对于包含TR000011_1_2020
的文档,也会创建一个2020
标记,而您的查询将与之匹配
您可以使用来检查基于分析器生成的令牌,如前所述,大部分令牌是匹配的,如上图所示。如果您说返回所有结果,您可以更具体一些,您应该在结果中提供一些示例文档、预期文档和当前文档,我已经多次使用过这个查询,它是有效的。@OpsterElasticsearchNinja添加了一个编辑,向您显示返回的数据样本(27个中的3个)。testRecordId
属性很重要。我还添加了index/_映射
GET来显示它正在使用分析器。我还能为您提供什么帮助?谢谢编辑:还添加了我如何使用kibana控制台测试结果,非常清楚,我知道为什么会出现这个问题,但要确认,我需要查看JSON格式的索引设置,您可以使用设置API来提供吗?@opterElasticSearchNinja我添加了一个编辑来显示\u设置
响应,如果有帮助的话。到目前为止非常感谢:)是的,根据analyze
API,这正是正在发生的事情!根据您的经验,对于这样的搜索场景,您倾向于使用什么方法?我是否必须将结果转换为通配符?使用通配符是我的第一次尝试,但由于通配符查询的大小写敏感,所以我遇到了一些问题keyword@JordanLewallen这是后续问题,您已经测试了analyzer API的O/P,并确认这是由于analyzer的不正确使用造成的,我希望你能投票,接受答案,并提出一个新的问题,这个问题集中在搜索用例上,这样一来,这两篇文章都会有重点,对社区有帮助:)@JordanLewallen也请在你有了新问题的链接后马上打电话给我,我会尽快为你提供有效的解决方案:)好的观点,在这里创建了一个新问题:将此问题标记为正确!非常感谢迄今为止的帮助