Swift自然语言框架错误“;令牌SequenceType长度为0“;

Swift自然语言框架错误“;令牌SequenceType长度为0“;,swift,xcode,natural-language-processing,swift4.2,createml,Swift,Xcode,Natural Language Processing,Swift4.2,Createml,我目前正在使用Apple的CreateML从我拥有的JSON文件生成NLP模型。这是我的密码: import Foundation import CreateML import NaturalLanguage let trainingData = try MLDataTable(contentsOf: Bundle.main.url(forResource: "Fel", withExtension: "json")!) let model = try MLWordTagger(trainin

我目前正在使用Apple的CreateML从我拥有的JSON文件生成NLP模型。这是我的密码:

import Foundation
import CreateML
import NaturalLanguage

let trainingData = try MLDataTable(contentsOf: Bundle.main.url(forResource: "Fel", withExtension: "json")!)
let model = try MLWordTagger(trainingData: trainingData, tokenColumn: "tokens", labelColumn: "labels")
let metadata = MLModelMetadata(author: "Sai Kambampati", shortDescription: "The Felicity Named Entity Recognizer", license: "MIT", version: "1.0")
try model.write(to: URL(fileURLWithPath: "/Users/SaiKambampati/Desktop/Felicity.mlmodel"), metadata: metadata)
JSON文件有116096行,Xcode能够正确解析它。它从5%的数据中生成了一个验证集。然而,当它开始标记数据和提取特征时,我得到了一个错误提示:

▿ MLCreateError
▿ 通用:1个元素
-原因:“令牌序列类型长度为0”


我不知道这意味着什么,在网上找不到任何东西!有人能帮忙吗?

您的JSON文件必须是这种格式,才能使用MLWordTagger的tokenColumn param.Tokens作为字符串列表,标签作为字符串列表

[
    {
      "tokens": [
        "Aprender",
        "a",
        "realizar",
        "Aquisição",
        "de",
        "usuários"
      ],
      "labels": [
        "GENERIC_ACTION",
        "NONE",
        "ACTION",
        "TOPIC",
        "NONE",
        "NONE"
      ]
    }, ...