Python 3.x 伯特:如何将伯特作为服务与BioBERT一起使用?
Python 3.x 伯特:如何将伯特作为服务与BioBERT一起使用?,python-3.x,nlp,bert-language-model,Python 3.x,Nlp,Bert Language Model,bioBERT抛出下面提到的错误: 但我可以使用以下语句运行其他BERT版本uncased_L-12_H-768_A-12和sciBERT: bert-serving-start -model_dir C:\Users\xyz\Desktop\data\dataset\uncased_L-12_H-768_A-12 -num_worker=1 希伯特 bert-serving-start -model_dir C:\Users\xyz\Desktop\data\dataset\bert_mod
bioBERT
抛出下面提到的错误:
但我可以使用以下语句运行其他BERT版本uncased_L-12_H-768_A-12
和sciBERT
:
bert-serving-start -model_dir C:\Users\xyz\Desktop\data\dataset\uncased_L-12_H-768_A-12 -num_worker=1
希伯特
bert-serving-start -model_dir C:\Users\xyz\Desktop\data\dataset\bert_models\scibert_scivocab_uncased -num_worker=1
但同样的语句不适用于bioBERT
:
贝奥伯特
bert-serving-start -model_dir C:\Users\xyz\Desktop\data\dataset\bert_models\biobert_v1.1_pubmed -num_worker=1
错误:
ARG VALUE
ckpt_name = bert_model.ckpt
config_name = bert_config.json
cors = *
cpu = False
device_map = []
do_lower_case = True
fixed_embed_length = False
fp16 = False
gpu_memory_fraction = 0.5
graph_tmp_dir = None
http_max_connect = 10
http_port = None
mask_cls_sep = False
max_batch_size = 256
max_seq_len = 25
model_dir = C:\Users\xyz\Desktop\data\dataset\bert_models\biobert_v1.1_pubmed
no_special_token = False
num_worker = 1
pooling_layer = [-2]
pooling_strategy = REDUCE_MEAN
port = 5555
port_out = 5556
prefetch_size = 10
priority_batch_size = 16
show_tokens_to_client = False
tuned_model_dir = None
verbose = False
xla = False
I:[35mVENTILATOR[0m:freeze, optimize and export graph, could take a while...
WARNING: Logging before flag parsing goes to stderr.
W0922 18:38:28.060485 2868 deprecation_wrapper.py:119] From c:\programdata\anaconda3\envs\bert_x\lib\site-packages\bert_serving\server\helper.py:184: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.
W0922 18:38:28.062525 2868 deprecation_wrapper.py:119] From c:\programdata\anaconda3\envs\bert_x\lib\site-packages\bert_serving\server\helper.py:184: The name tf.logging.ERROR is deprecated. Please use tf.compat.v1.logging.ERROR instead.
I:[36mGRAPHOPT[0m:model config: C:\Users\xyz\Desktop\data\dataset\bert_models\biobert_v1.1_pubmed\bert_config.json
I:[36mGRAPHOPT[0m:checkpoint: C:\Users\xyz\Desktop\data\dataset\bert_models\biobert_v1.1_pubmed\bert_model.ckpt
E:[36mGRAPHOPT[0m:fail to optimize the graph!
Traceback (most recent call last):
File "c:\programdata\anaconda3\envs\bert_x\lib\runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
File "c:\programdata\anaconda3\envs\bert_x\lib\runpy.py", line 85, in _run_code
exec(code, run_globals)
File "C:\ProgramData\Anaconda3\envs\bert_x\Scripts\bert-serving-start.exe\__main__.py", line 9, in <module>
File "c:\programdata\anaconda3\envs\bert_x\lib\site-packages\bert_serving\server\cli\__init__.py", line 4, in main
with BertServer(get_run_args()) as server:
File "c:\programdata\anaconda3\envs\bert_x\lib\site-packages\bert_serving\server\__init__.py", line 71, in __init__
self.graph_path, self.bert_config = pool.apply(optimize_graph, (self.args,))
TypeError: cannot unpack non-iterable NoneType object
ARG值
ckpt\u name=bert\u model.ckpt
config\u name=bert\u config.json
cors=*
cpu=错误
设备映射=[]
do_lower_case=真
固定嵌入长度=假
fp16=假
gpu_内存_分数=0.5
图形\u tmp\u dir=无
http_max_connect=10
http_端口=无
掩码\u cls\u sep=假
最大批量大小=256
最大长度=25
model\u dir=C:\Users\xyz\Desktop\data\dataset\bert\u models\biobert\u v1.1\u pubmed
无特殊标记=错误
num_worker=1
池_层=[-2]
合并策略=减少平均值
端口=5555
端口输出=5556
预取大小=10
优先级\批次\大小=16
向客户端显示\u令牌\u=False
调整的\u模型\u目录=无
冗长=错误
XLA=假
I:[35mVENTILATOR[0m:冻结、优化和导出图形,可能需要一段时间。。。
警告:在标记解析转到stderr之前进行日志记录。
W0922 18:38:28.060485 2868不推荐使用\u wrapper.py:119]来自c:\programdata\anaconda3\envs\bert\u x\lib\site packages\bert\u serving\server\helper.py:184:不推荐使用名称tf.logging.set\u verbosity。请改用tf.compat.v1.logging.set\u verbosity。
W0922 18:38:28.062525 2868弃用\u wrapper.py:119]来自c:\programdata\anaconda3\envs\bert\u x\lib\site packages\bert\u serving\server\helper.py:184:名称tf.logging.ERROR已弃用。请改用tf.compat.v1.logging.ERROR。
I:[36mGRAPHOPT[0m:model config:C:\Users\xyz\Desktop\data\dataset\bert\u models\biobert\u v1.1\u pubmed\bert\u config.json
I:[36mGRAPHOPT[0m:检查点:C:\Users\xyz\Desktop\data\dataset\bert\u models\biobert\u v1.1\u pubmed\bert\u model.ckpt
E:[36mGRAPHOPT[0m:无法优化图形!
回溯(最近一次呼叫最后一次):
文件“c:\programdata\anaconda3\envs\bert\u x\lib\runpy.py”,第193行,位于作为主模块的运行模块中
“\uuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuuu
文件“c:\programdata\anaconda3\envs\bert\u x\lib\runpy.py”,第85行,在运行代码中
exec(代码、运行\全局)
文件“C:\ProgramData\Anaconda3\envs\bert\u x\Scripts\bert serving start.exe\\uuuuuu main\uuuuuuu.py”,第9行,在
文件“c:\programdata\anaconda3\envs\bert\u x\lib\site packages\bert\u serving\server\cli\\uuuuuuu init\uuuuuuuuuuu.py”,第4行,主目录
使用BertServer(get_run_args())作为服务器:
文件“c:\programdata\anaconda3\envs\bert\u x\lib\site packages\bert\u serving\server\\uuuuuu init\uuuuu.py”,第71行,在\uuu init中__
self.graph\u path,self.bert\u config=pool.apply(优化图,(self.args,))
TypeError:无法解压缩不可编辑的非类型对象
我将BioBert文件重命名为与原始的BERT文件相同的文件,并且可以正常工作。谢谢你,我最近发现了它