Python ImportError:没有名为';蜘蛛';
在命令行上,我正在执行以下调用scrapy的简单尝试:Python ImportError:没有名为';蜘蛛';,python,scrapy,Python,Scrapy,在命令行上,我正在执行以下调用scrapy的简单尝试: scrapy version 我得到以下错误: $ scrapy version Traceback (most recent call last): File "/Users/nathanielford/virtualenvironments/crawler/bin/scrapy", line 11, in <module> sys.exit(execute()) File "/Users/nathaniel
scrapy version
我得到以下错误:
$ scrapy version
Traceback (most recent call last):
File "/Users/nathanielford/virtualenvironments/crawler/bin/scrapy", line 11, in <module>
sys.exit(execute())
File "/Users/nathanielford/virtualenvironments/crawler/lib/python3.5/site-packages/scrapy/cmdline.py", line 141, in execute
cmd.crawler_process = CrawlerProcess(settings)
File "/Users/nathanielford/virtualenvironments/crawler/lib/python3.5/site-packages/scrapy/crawler.py", line 238, in __init__
super(CrawlerProcess, self).__init__(settings)
File "/Users/nathanielford/virtualenvironments/crawler/lib/python3.5/site-packages/scrapy/crawler.py", line 129, in __init__
self.spider_loader = _get_spider_loader(settings)
File "/Users/nathanielford/virtualenvironments/crawler/lib/python3.5/site-packages/scrapy/crawler.py", line 325, in _get_spider_loader
return loader_cls.from_settings(settings.frozencopy())
File "/Users/nathanielford/virtualenvironments/crawler/lib/python3.5/site-packages/scrapy/spiderloader.py", line 33, in from_settings
return cls(settings)
File "/Users/nathanielford/virtualenvironments/crawler/lib/python3.5/site-packages/scrapy/spiderloader.py", line 20, in __init__
self._load_all_spiders()
File "/Users/nathanielford/virtualenvironments/crawler/lib/python3.5/site-packages/scrapy/spiderloader.py", line 28, in _load_all_spiders
for module in walk_modules(name):
File "/Users/nathanielford/virtualenvironments/crawler/lib/python3.5/site-packages/scrapy/utils/misc.py", line 63, in walk_modules
mod = import_module(path)
File "/Users/nathanielford/virtualenvironments/crawler/lib/python3.5/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 986, in _gcd_import
File "<frozen importlib._bootstrap>", line 969, in _find_and_load
File "<frozen importlib._bootstrap>", line 956, in _find_and_load_unlocked
ImportError: No module named 'spiders'
导致导入错误的原因:没有名为“spider”的模块。此错误是由我的
settings.py
文件引起的,其中我有以下内容:
SPIDER_MODULES = ['spiders']
虽然它位于
scrapy
提供的默认项目中,但我已经移动了该模块。该列表中的值必须是完全限定的模块名:即使是执行scrapy
也会加载设置文件,从而尝试从项目中导入模块。如果它能找到一个设置文件,它就必须是正确的。太棒了,我建议在
SPIDER_MODULES = ['spiders']