Machine learning FastText类使用未定义的对象

Machine learning FastText类使用未定义的对象,machine-learning,nlp,fasttext,Machine Learning,Nlp,Fasttext,我在读一篇我在这里找到的文章时遇到了FastText类 作者使用了一个未定义的对象“word_tokenized_corpus” 我犯了一个错误,原因很明显。如何正确启动该类?作者已对文章进行了更新,并添加了以下代码: final_corpus = [ preprocess_text(sentence) for sentence in artificial_intelligence if sentence.strip() != "" ] word_punctuatio

我在读一篇我在这里找到的文章时遇到了FastText类

作者使用了一个未定义的对象“word_tokenized_corpus”


我犯了一个错误,原因很明显。如何正确启动该类?

作者已对文章进行了更新,并添加了以下代码:

final_corpus = [
    preprocess_text(sentence)
    for sentence in artificial_intelligence
    if sentence.strip() != ""
]

word_punctuation_tokenizer = nltk.WordPunctTokenizer()
word_tokenized_corpus = [
    word_punctuation_tokenizer.tokenize(sent) for sent in final_corpus
]
final_corpus = [
    preprocess_text(sentence)
    for sentence in artificial_intelligence
    if sentence.strip() != ""
]

word_punctuation_tokenizer = nltk.WordPunctTokenizer()
word_tokenized_corpus = [
    word_punctuation_tokenizer.tokenize(sent) for sent in final_corpus
]