Deep learning fastai库是否自动从标题推断文本和标签?
我有一个dataframe对象,它有两个字段,即文本和标签,我想做类似于ULMFit的文本分类 以下是具有以下特定用途的代码Deep learning fastai库是否自动从标题推断文本和标签?,deep-learning,pytorch,fast-ai,Deep Learning,Pytorch,Fast Ai,我有一个dataframe对象,它有两个字段,即文本和标签,我想做类似于ULMFit的文本分类 以下是具有以下特定用途的代码 data_lm = TextLMDataBunch.from_df(train_df = df_trn, valid_df = df_val, path = "") # Language model learner object data_clas = TextClasDataBunch.from_df(path = "", train_df = df_trn, va
data_lm = TextLMDataBunch.from_df(train_df = df_trn, valid_df = df_val, path = "")
# Language model learner object
data_clas = TextClasDataBunch.from_df(path = "", train_df = df_trn, valid_df = df_val, vocab=data_lm.train_ds.vocab, bs=32)
分类对象
learn = language_model_learner(data_lm, AWD_LSTM, drop_mult=0.5)
# learn language model object
learn.fit_one_cycle(10, 1e-2)
# Fit a language model
learn.save_encoder('good_ft_enc')
# save the encoder of the language model
learn = text_classifier_learner(data_clas,AWD_LSTM,drop_mult=0.7)
learn.load_encoder('good_ft_enc')
# classifier object with the loaded encoder
learn.fit_one_cycle(3, 1e-2)
# fit the classifier
以下是所遵循的一系列步骤,但我无法理解dataloader是否正确加载了我的文本和标签字段,因为我没有在函数参数中的任何位置提供它们。任何帮助都将不胜感激API是最新fastai 1.0的基本构建块+
因此,无论是TextLMDataBunch.from_-df
(或textclasdabunch.from_-df
)代表您做几件事,包括定义火炬数据集、创建标签、将其拆分为训练/测试等
我强烈建议您仔细阅读数据块文档
API是最新fastai 1.0的基本构建块+
因此,无论是TextLMDataBunch.from_-df
(或textclasdabunch.from_-df
)代表您做几件事,包括定义火炬数据集、创建标签、将其拆分为训练/测试等
我强烈建议您仔细阅读数据块文档