Rasa nlu Rasa nlu解析请求给出错误的意图结果

Rasa NLU版本（例如0.7.3）：0.10.0a6

使用的后端/管道（mitie、spacy\u sklearn等）：

[“nlp\u spacy”、“标记器\u spacy”、“意图\u特征化器\u spacy”、“ner\u crf”、“ner\u同义词”、“意图\u分类器\u sklearn”、“ner\u spacy”]

操作系统（windows、osx等）：windows server 2012 R2

问题：我已安装Rasa nlu 0.10.0a6版本。我的确认文件看起来像

{

"project":"Project",
"pipeline" : ["nlp_spacy", "tokenizer_spacy", "intent_featurizer_spacy","ner_crf", "ner_synonyms", "intent_classifier_sklearn","ner_spacy"],
"path" : "./projects",

"cors_origins":["*"],
"data" : "./data/examples/rasa/People.json"
}

{
  "rasa_nlu_data": {
    "regex_features": [
      {
        "name": "zipcode",
        "pattern": "[0-9]{5}"
      }
    ],
    "entity_synonyms": [
      {
        "value": "chinese",
        "synonyms": ["Chinese", "Chines", "chines"]
      },
      {
        "value": "vegetarian",
        "synonyms": ["veggie", "vegg"]
      }
    ],
    "common_examples": [
      {
        "text": "hey", 
        "intent": "greet", 
        "entities": []
      }, 
      {
        "text": "howdy", 
        "intent": "greet", 
        "entities": []
      }, 
      {
        "text": "hey there",
        "intent": "greet", 
        "entities": []
      }, 
      {
        "text": "hello", 
        "intent": "greet", 
        "entities": []
      }, 
      {
        "text": "hi", 
        "intent": "greet", 
        "entities": []
      },
      {
        "text": "good morning",
        "intent": "greet",
        "entities": []
      },
      {
        "text": "good evening",
        "intent": "greet",
        "entities": []
      },
      {
        "text": "dear sir",
        "intent": "greet",
        "entities": []
      },
      {
        "text": "yes", 
        "intent": "affirm", 
        "entities": []
      }, 
      {
        "text": "yep", 
        "intent": "affirm", 
        "entities": []
      }, 
      {
        "text": "yeah", 
        "intent": "affirm", 
        "entities": []
      },
      {
        "text": "indeed",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "that's right",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "ok",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "great",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "right, thank you",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "correct",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "great choice",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "sounds really good",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "i'm looking for a place to eat",
        "intent": "restaurant_search",
        "entities": []
      },
      {
        "text": "I want to grab lunch",
        "intent": "restaurant_search",
        "entities": []
      },
      {
        "text": "I am searching for a dinner spot",
        "intent": "restaurant_search",
        "entities": []
      },
      {
        "text": "i'm looking for a place in the north of town",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 31,
            "end": 36,
            "value": "north",
            "entity": "location"
          }
        ]
      },
      {
        "text": "show me chinese restaurants",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 8,
            "end": 15,
            "value": "chinese",
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "show me chines restaurants",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 8,
            "end": 14,
            "value": "chinese",
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "show me a mexican place in the centre", 
        "intent": "restaurant_search", 
        "entities": [
          {
            "start": 31, 
            "end": 37, 
            "value": "centre", 
            "entity": "location"
          }, 
          {
            "start": 10, 
            "end": 17, 
            "value": "mexican", 
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "i am looking for an indian spot called olaolaolaolaolaola",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 20,
            "end": 26,
            "value": "indian",
            "entity": "cuisine"
          }
        ]
      },     {
        "text": "search for restaurants",
        "intent": "restaurant_search",
        "entities": []
      },
      {
        "text": "anywhere in the west",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 16,
            "end": 20,
            "value": "west",
            "entity": "location"
          }
        ]
      },
      {
        "text": "anywhere near 18328",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 14,
            "end": 19,
            "value": "18328",
            "entity": "location"
          }
        ]
      },
      {
        "text": "I am looking for asian fusion food",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 17,
            "end": 29,
            "value": "asian fusion",
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "I am looking a restaurant in 29432",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 29,
            "end": 34,
            "value": "29432",
            "entity": "location"
          }
        ]
      },
      {
        "text": "I am looking for mexican indian fusion",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 17,
            "end": 38,
            "value": "mexican indian fusion",
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "central indian restaurant",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 0,
            "end": 7,
            "value": "central",
            "entity": "location"
          },
          {
            "start": 8,
            "end": 14,
            "value": "indian",
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "bye", 
        "intent": "goodbye", 
        "entities": []
      }, 
      {
        "text": "goodbye", 
        "intent": "goodbye", 
        "entities": []
      }, 
      {
        "text": "good bye", 
        "intent": "goodbye", 
        "entities": []
      }, 
      {
        "text": "stop", 
        "intent": "goodbye", 
        "entities": []
      }, 
      {
        "text": "end", 
        "intent": "goodbye", 
        "entities": []
      },
      {
        "text": "farewell",
        "intent": "goodbye",
        "entities": []
      },
      {
        "text": "Bye bye",
        "intent": "goodbye",
        "entities": []
      },
      {
        "text": "have a good one",
        "intent": "goodbye",
        "entities": []
      }
    ]
  }
}

我的数据文件看起来像

{

"project":"Project",
"pipeline" : ["nlp_spacy", "tokenizer_spacy", "intent_featurizer_spacy","ner_crf", "ner_synonyms", "intent_classifier_sklearn","ner_spacy"],
"path" : "./projects",

"cors_origins":["*"],
"data" : "./data/examples/rasa/People.json"
}

{
  "rasa_nlu_data": {
    "regex_features": [
      {
        "name": "zipcode",
        "pattern": "[0-9]{5}"
      }
    ],
    "entity_synonyms": [
      {
        "value": "chinese",
        "synonyms": ["Chinese", "Chines", "chines"]
      },
      {
        "value": "vegetarian",
        "synonyms": ["veggie", "vegg"]
      }
    ],
    "common_examples": [
      {
        "text": "hey", 
        "intent": "greet", 
        "entities": []
      }, 
      {
        "text": "howdy", 
        "intent": "greet", 
        "entities": []
      }, 
      {
        "text": "hey there",
        "intent": "greet", 
        "entities": []
      }, 
      {
        "text": "hello", 
        "intent": "greet", 
        "entities": []
      }, 
      {
        "text": "hi", 
        "intent": "greet", 
        "entities": []
      },
      {
        "text": "good morning",
        "intent": "greet",
        "entities": []
      },
      {
        "text": "good evening",
        "intent": "greet",
        "entities": []
      },
      {
        "text": "dear sir",
        "intent": "greet",
        "entities": []
      },
      {
        "text": "yes", 
        "intent": "affirm", 
        "entities": []
      }, 
      {
        "text": "yep", 
        "intent": "affirm", 
        "entities": []
      }, 
      {
        "text": "yeah", 
        "intent": "affirm", 
        "entities": []
      },
      {
        "text": "indeed",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "that's right",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "ok",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "great",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "right, thank you",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "correct",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "great choice",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "sounds really good",
        "intent": "affirm",
        "entities": []
      },
      {
        "text": "i'm looking for a place to eat",
        "intent": "restaurant_search",
        "entities": []
      },
      {
        "text": "I want to grab lunch",
        "intent": "restaurant_search",
        "entities": []
      },
      {
        "text": "I am searching for a dinner spot",
        "intent": "restaurant_search",
        "entities": []
      },
      {
        "text": "i'm looking for a place in the north of town",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 31,
            "end": 36,
            "value": "north",
            "entity": "location"
          }
        ]
      },
      {
        "text": "show me chinese restaurants",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 8,
            "end": 15,
            "value": "chinese",
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "show me chines restaurants",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 8,
            "end": 14,
            "value": "chinese",
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "show me a mexican place in the centre", 
        "intent": "restaurant_search", 
        "entities": [
          {
            "start": 31, 
            "end": 37, 
            "value": "centre", 
            "entity": "location"
          }, 
          {
            "start": 10, 
            "end": 17, 
            "value": "mexican", 
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "i am looking for an indian spot called olaolaolaolaolaola",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 20,
            "end": 26,
            "value": "indian",
            "entity": "cuisine"
          }
        ]
      },     {
        "text": "search for restaurants",
        "intent": "restaurant_search",
        "entities": []
      },
      {
        "text": "anywhere in the west",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 16,
            "end": 20,
            "value": "west",
            "entity": "location"
          }
        ]
      },
      {
        "text": "anywhere near 18328",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 14,
            "end": 19,
            "value": "18328",
            "entity": "location"
          }
        ]
      },
      {
        "text": "I am looking for asian fusion food",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 17,
            "end": 29,
            "value": "asian fusion",
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "I am looking a restaurant in 29432",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 29,
            "end": 34,
            "value": "29432",
            "entity": "location"
          }
        ]
      },
      {
        "text": "I am looking for mexican indian fusion",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 17,
            "end": 38,
            "value": "mexican indian fusion",
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "central indian restaurant",
        "intent": "restaurant_search",
        "entities": [
          {
            "start": 0,
            "end": 7,
            "value": "central",
            "entity": "location"
          },
          {
            "start": 8,
            "end": 14,
            "value": "indian",
            "entity": "cuisine"
          }
        ]
      },
      {
        "text": "bye", 
        "intent": "goodbye", 
        "entities": []
      }, 
      {
        "text": "goodbye", 
        "intent": "goodbye", 
        "entities": []
      }, 
      {
        "text": "good bye", 
        "intent": "goodbye", 
        "entities": []
      }, 
      {
        "text": "stop", 
        "intent": "goodbye", 
        "entities": []
      }, 
      {
        "text": "end", 
        "intent": "goodbye", 
        "entities": []
      },
      {
        "text": "farewell",
        "intent": "goodbye",
        "entities": []
      },
      {
        "text": "Bye bye",
        "intent": "goodbye",
        "entities": []
      },
      {
        "text": "have a good one",
        "intent": "goodbye",
        "entities": []
      }
    ]
  }
}

使用上面的配置和json数据，我已经用下面的HTTP端点训练了Rasa

/培训？项目=项目

培训数据之后，在一个使用培训数据创建的项目文件夹中

我用下面的命令启动了Rasa服务器

python-m rasa_nlu.server-c config_spacy.json

现在服务器以端口5000启动

当我可以执行“/parse？q=hello&project=project”解析结束点时，我得到的响应如下

{
  "intent": {
    "name": "greet",
    "confidence": 0.6409561289105246
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "greet",
      "confidence": 0.6409561289105246
    },
    {
      "name": "goodbye",
      "confidence": 0.16788352870824252
    },
    {
      "name": "restaurant_search",
      "confidence": 0.10908268742176423
    },
    {
      "name": "affirm",
      "confidence": 0.08207765495946878
    }
  ],
  "text": "hello"
}

{
  "intent": {
    "name": "affirm",
    "confidence": 0.7718580601897227
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "affirm",
      "confidence": 0.7718580601897227
    },
    {
      "name": "goodbye",
      "confidence": 0.11611828257295627
    },
    {
      "name": "greet",
      "confidence": 0.07060567364272623
    },
    {
      "name": "restaurant_search",
      "confidence": 0.04141798359459499
    }
  ],
  "text": "Great choice"
}

{
  "intent": {
    "name": "None",
    "confidence": 1
  },
  "entities": [],
  "text": "Great choice"
}

{
  "intent": {
    "name": "goodbye",
    "confidence": 0.40930529216955336
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "goodbye",
      "confidence": 0.40930529216955336
    },
    {
      "name": "restaurant_search",
      "confidence": 0.31818118919270977
    },
    {
      "name": "greet",
      "confidence": 0.20524111006007764
    },
    {
      "name": "affirm",
      "confidence": 0.06727240857765926
    }
  ],
  "text": "Book a cab"
}

当我可以执行'/parse？q=Great choice&project=project'解析结束点时，我得到的响应低于预期

{
  "intent": {
    "name": "greet",
    "confidence": 0.6409561289105246
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "greet",
      "confidence": 0.6409561289105246
    },
    {
      "name": "goodbye",
      "confidence": 0.16788352870824252
    },
    {
      "name": "restaurant_search",
      "confidence": 0.10908268742176423
    },
    {
      "name": "affirm",
      "confidence": 0.08207765495946878
    }
  ],
  "text": "hello"
}

{
  "intent": {
    "name": "affirm",
    "confidence": 0.7718580601897227
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "affirm",
      "confidence": 0.7718580601897227
    },
    {
      "name": "goodbye",
      "confidence": 0.11611828257295627
    },
    {
      "name": "greet",
      "confidence": 0.07060567364272623
    },
    {
      "name": "restaurant_search",
      "confidence": 0.04141798359459499
    }
  ],
  "text": "Great choice"
}

{
  "intent": {
    "name": "None",
    "confidence": 1
  },
  "entities": [],
  "text": "Great choice"
}

{
  "intent": {
    "name": "goodbye",
    "confidence": 0.40930529216955336
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "goodbye",
      "confidence": 0.40930529216955336
    },
    {
      "name": "restaurant_search",
      "confidence": 0.31818118919270977
    },
    {
      "name": "greet",
      "confidence": 0.20524111006007764
    },
    {
      "name": "affirm",
      "confidence": 0.06727240857765926
    }
  ],
  "text": "Book a cab"
}

当我可以执行'/parse？q=Great choice&Project=Project'解析结束点时，我得到的响应低于预期

{
  "intent": {
    "name": "greet",
    "confidence": 0.6409561289105246
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "greet",
      "confidence": 0.6409561289105246
    },
    {
      "name": "goodbye",
      "confidence": 0.16788352870824252
    },
    {
      "name": "restaurant_search",
      "confidence": 0.10908268742176423
    },
    {
      "name": "affirm",
      "confidence": 0.08207765495946878
    }
  ],
  "text": "hello"
}

{
  "intent": {
    "name": "affirm",
    "confidence": 0.7718580601897227
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "affirm",
      "confidence": 0.7718580601897227
    },
    {
      "name": "goodbye",
      "confidence": 0.11611828257295627
    },
    {
      "name": "greet",
      "confidence": 0.07060567364272623
    },
    {
      "name": "restaurant_search",
      "confidence": 0.04141798359459499
    }
  ],
  "text": "Great choice"
}

{
  "intent": {
    "name": "None",
    "confidence": 1
  },
  "entities": [],
  "text": "Great choice"
}

{
  "intent": {
    "name": "goodbye",
    "confidence": 0.40930529216955336
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "goodbye",
      "confidence": 0.40930529216955336
    },
    {
      "name": "restaurant_search",
      "confidence": 0.31818118919270977
    },
    {
      "name": "greet",
      "confidence": 0.20524111006007764
    },
    {
      "name": "affirm",
      "confidence": 0.06727240857765926
    }
  ],
  "text": "Book a cab"
}

当我可以执行“/parse？q=bookab&project=project”解析结束点时，我得到的响应如下

{
  "intent": {
    "name": "greet",
    "confidence": 0.6409561289105246
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "greet",
      "confidence": 0.6409561289105246
    },
    {
      "name": "goodbye",
      "confidence": 0.16788352870824252
    },
    {
      "name": "restaurant_search",
      "confidence": 0.10908268742176423
    },
    {
      "name": "affirm",
      "confidence": 0.08207765495946878
    }
  ],
  "text": "hello"
}

{
  "intent": {
    "name": "affirm",
    "confidence": 0.7718580601897227
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "affirm",
      "confidence": 0.7718580601897227
    },
    {
      "name": "goodbye",
      "confidence": 0.11611828257295627
    },
    {
      "name": "greet",
      "confidence": 0.07060567364272623
    },
    {
      "name": "restaurant_search",
      "confidence": 0.04141798359459499
    }
  ],
  "text": "Great choice"
}

{
  "intent": {
    "name": "None",
    "confidence": 1
  },
  "entities": [],
  "text": "Great choice"
}

{
  "intent": {
    "name": "goodbye",
    "confidence": 0.40930529216955336
  },
  "entities": [],
  "intent_ranking": [
    {
      "name": "goodbye",
      "confidence": 0.40930529216955336
    },
    {
      "name": "restaurant_search",
      "confidence": 0.31818118919270977
    },
    {
      "name": "greet",
      "confidence": 0.20524111006007764
    },
    {
      "name": "affirm",
      "confidence": 0.06727240857765926
    }
  ],
  "text": "Book a cab"
}

通过这种方式，对于每个请求，它都会以适当的结果进行响应，有时不会。如果你能观察到Parse_Responce2.txt和Parse_Responce3.txt中的这两个响应，我刚刚从小的“p”更改为大写的“p”，因为这个更改，我得到了每个请求的不同结果

在经过培训的数据中，没有“预订出租车”文本或与之相关的任何意图。但当我使用这个文本发送解析时，我并没有得到任何意图，而是返回了意图结果。对于任何随机的解析请求，我没有得到任何意图

这是我的训练问题还是出了什么问题。 请让我知道如何才能获得正确的意图结果以及实体结果

配置文件的内容（如果使用和相关）：

---

URL参数区分大小写，这就是为什么这两个

great choice

示例有不同的输出。在第二个案例中，Rasa没有找到要分析的项目/模型

---

Rasa NLU将始终返回匹配的意图。在上一个例子中，你可以看到它返回了一个意图，但是可信度很低。处理这件事就是所谓的。讨论的处理回退的两种主要方法是实现在置信度低于某个阈值时接管的逻辑，或者训练实际的回退意图，该意图包含所有您想要捕获的非意图示例

URL参数区分大小写，这就是为什么这两个

great choice

示例具有不同的输出。在第二个案例中，Rasa没有找到要分析的项目/模型

---

Rasa NLU将始终返回匹配的意图。在上一个例子中，你可以看到它返回了一个意图，但是可信度很低。处理这件事就是所谓的。讨论的处理回退的两种主要方法是实现在置信度低于某个阈值时接管的逻辑，或者训练实际的回退意图，该意图包含所有您想要捕获的非意图示例

我在使用Rasa NLU时也遇到了同样的问题，我有大约120个示例，用于5种不同的意图，以及5-7种实体。在这里，您似乎使用了

spacy sklearn

管道。

spaCy

通常需要更多数据来训练和检测意图和（更多）实体。文件说，500-1000个例子将被认为是图书馆“体面和好的”

在我的例子中，我将我的管道更改为MITIE sklearn，我得到了一个像样的模型，只训练了80个示例和与以前相同数量的意图。

---

此外，spaCy的速度往往更快，正如您可能已经注意到的，但是对于80个示例模型，MITIE确实需要大约6分钟。

我在使用Rasa NLU时遇到了同样的问题，其中我有大约120个示例，用于5个不同的意图，以及5-7个实体。在这里，您似乎使用了

spacy sklearn

管道。

spaCy

通常需要更多数据来训练和检测意图和（更多）实体。文件说，500-1000个例子将被认为是图书馆“体面和好的”

在我的例子中，我将我的管道更改为MITIE sklearn，我得到了一个像样的模型，只训练了80个示例和与以前相同数量的意图。

---

同样，spaCy的速度也会更快，正如您可能已经注意到的，但是对于80个示例模型来说，

MITIE

确实需要大约6分钟。

我也面临同样的问题，原因是公共示例部分没有足够的数据，所以我所做的是多次复制和粘贴它们，并对它们进行培训，然后bot正常工作。您可以在rasa core中看到resturant bot示例的相同内容，例如：{“text”：“cheap”，“intent”：“price”，“entities”：[]}，重复多次如果您的示例是文本，则可能存在url编码问题。空格不是url中的有效字符。您必须将其替换为空间的十六进制代码%20。所以“伟大的选择”变成了“伟大的%20choice”。我也面临着同样的问题，原因是在通用示例部分没有足够的数据，所以我所做的是多次复制和粘贴它们，并对它们进行培训，然后bot正常工作。您可以在rasa core中看到resturant bot示例的相同内容，例如：{“text”：“cheap”，“intent”：“price”，“entities”：[]}，重复多次如果您的示例是文本，则可能存在url编码问题。空格不是url中的有效字符。您必须将其替换为空间的十六进制代码%20。所以“伟大的选择”变成了“伟大的选择”。