Python 从当前项目向scrapyd添加新服务
我想从scrapy项目中为scrapyd创建一个自定义服务,但我一直遇到错误 我创建了Python 从当前项目向scrapyd添加新服务,python,web-scraping,scrapy,web-crawler,scrapyd,Python,Web Scraping,Scrapy,Web Crawler,Scrapyd,我想从scrapy项目中为scrapyd创建一个自定义服务,但我一直遇到错误 我创建了crawler/webservice.py: from scrapyd.webservice import WsResource class BackInTime(WsResource): def render_GET(self, txtrequest): return { 'id': 'something works!' } 然后修改了sc
crawler/webservice.py
:
from scrapyd.webservice import WsResource
class BackInTime(WsResource):
def render_GET(self, txtrequest):
return {
'id': 'something works!'
}
然后修改了scrapyd.conf
,并在[services]
标记下添加了行backintime.json=crawler.webservice.backintime
Bu当我运行命令scrapyd
时,我不断得到错误:
...
File "c:\personal\virtualenvs\crawlie\lib\site-packages\scrapyd\app.py", line 39, in application
webservice = TCPServer(http_port, server.Site(webcls(config, app)), interface=bind_address)
File "c:\personal\virtualenvs\crawlie\lib\site-packages\scrapyd\website.py", line 33, in __init__
servCls = load_object(servClsName)
File "c:\personal\virtualenvs\crawlie\lib\site-packages\scrapy\utils\misc.py", line 46, in load_object
mod = import_module(module)
File "C:\Users\user\Anaconda3\lib\importlib\__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 994, in _gcd_import
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 941, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "<frozen importlib._bootstrap>", line 994, in _gcd_import
File "<frozen importlib._bootstrap>", line 971, in _find_and_load
File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked
builtins.ModuleNotFoundError: No module named 'crawler'
Failed to load application: No module named 'crawler'
。。。
文件“c:\personal\virtualenvs\crawrie\lib\site packages\scrapyd\app.py”,第39行,在应用程序中
webservice=TCPServer(http_端口,server.Site(webcls(config,app)),interface=bind_地址)
文件“c:\personal\virtualenvs\crawrie\lib\site packages\scrapyd\website.py”,第33行,在\uuu init中__
servCls=load\u对象(servClsName)
文件“c:\personal\virtualenvs\crawrie\lib\site packages\scrapy\utils\misc.py”,第46行,在load\u对象中
mod=导入模块(模块)
文件“C:\Users\user\Anaconda3\lib\importlib\\uuuu init\uuuu.py”,第126行,在导入模块中
return _bootstrap._gcd_import(名称[级别:],包,级别)
文件“”,第994行,在_gcd_导入中
文件“”,第971行,在_find_和_load中
文件“”,第941行,在“查找”和“加载”中解锁
文件“”,第219行,在“调用”中,删除了“帧”
文件“”,第994行,在_gcd_导入中
文件“”,第971行,在_find_和_load中
文件“”,第953行,在“查找”和“加载”中解锁
builtins.ModuleNotFoundError:没有名为“crawler”的模块
加载应用程序失败:没有名为“爬虫”的模块
尝试遵循以前的一些解决方案,但没有成功: