Python 刮擦教程扭曲错误
我是Scrapy的新手,对python只有基本的了解。Python 刮擦教程扭曲错误,python,scrapy,Python,Scrapy,我是Scrapy的新手,对python只有基本的了解。 运行Scrapy教程时遇到错误。 我安装了Windows 7操作系统、64位和32位Python 2.7.12 到目前为止我已经采取的步骤 按照安装页面中的步骤进行操作,并设置虚拟环境“scrapy” 激活虚拟环境 安装了scrapy(所有依赖项似乎也都安装得很好,包括32位版本的pywin) 按照教程页面运行步骤 scrapy startproject教程 创建的文件quotes\u spider.py,代码在 从scrapy\Scri
运行Scrapy教程时遇到错误。
我安装了Windows 7操作系统、64位和32位Python 2.7.12
到目前为止我已经采取的步骤
- 按照安装页面中的步骤进行操作,并设置虚拟环境“scrapy”
- 激活虚拟环境
- 安装了scrapy(所有依赖项似乎也都安装得很好,包括32位版本的pywin)
- 按照教程页面运行步骤
scrapy startproject教程
- 创建的文件
,代码在quotes\u spider.py
- 从scrapy\Scripts\tutorial中,我运行了
,并得到以下错误scrapy爬行引号
(scrapy) F:\My Projects\scrapy\Scripts\tutorial>scrapy crawl quotes 2016-11-05 14:21:59 [scrapy] INFO: Scrapy 1.2.1 started (bot: tutorial) 2016-11-05 14:21:59 [scrapy] INFO: Overridden settings: {'NEWSPIDER_MODULE': 'tutorial.spiders', 'SPIDER_MODULES': ['tutorial.spiders'], 'ROBOTSTXT_OBEY': True, 'BOT_NAME': 'tutorial'} 2016-11-05 14:21:59 [scrapy] INFO: Enabled extensions:'scrapy.extensions.logstats.LogStats','scrapy.extensions.telnet.Telne tConsole', 'scrapy.extensions.corestats.CoreStats'] Unhandled error in Deferred: 2016-11-05 14:21:59 [twisted] CRITICAL: Unhandled error in Deferred: 2016-11-05 14:21:59 [twisted] CRITICAL: Traceback (most recent call last): File "f:\myproj~1\scrapy\lib\site-packages\twisted\internet\defer.py", line 12 60, in _inlineCallbacks result = g.send(result) File "f:\myproj~1\scrapy\lib\site-packages\scrapy\crawler.py", line 90, in crawl six.reraise(*exc_info) File "f:\myproj~1\scrapy\lib\site-packages\scrapy\crawler.py", line 72, in crawl self.engine = self._create_engine() File "f:\myproj~1\scrapy\lib\site-packages\scrapy\crawler.py", line 97, in _create_engine return ExecutionEngine(self, lambda _: self.stop()) File "f:\myproj~1\scrapy\lib\site-packages\scrapy\core\engine.py", line 68, in __init__ self.downloader = downloader_cls(crawler) File "f:\myproj~1\scrapy\lib\site- packages\scrapy\core\downloader\__init__.py" , line 88, in __init__ self.middleware = DownloaderMiddlewareManager.from_crawler(crawler) File "f:\myproj~1\scrapy\lib\site-packages\scrapy\middleware.py", line 58, in from_crawler return cls.from_settings(crawler.settings, crawler) File "f:\myproj~1\scrapy\lib\site-packages\scrapy\middleware.py", line 34, in from_settings mwcls = load_object(clspath) File "f:\myproj~1\scrapy\lib\site-packages\scrapy\utils\misc.py", line 44, in load_object mod = import_module(module) File "c:\python27\Lib\importlib\__init__.py", line 37, in import_module__import__(name) File "f:\myproj~1\scrapy\lib\site- packages\scrapy\downloadermiddlewares\retry.py", line 23, in <module> from scrapy.xlib.tx import ResponseFailed File "f:\myproj~1\scrapy\lib\site-packages\scrapy\xlib\tx\__init__.py", line 3, in <module> from twisted.web import client File "f:\myproj~1\scrapy\lib\site-packages\twisted\web\client.py", line 42, in <module> from twisted.internet.endpoints import TCP4ClientEndpoint, SSL4ClientEndpoint File "f:\myproj~1\scrapy\lib\site-packages\twisted\internet\endpoints.py", line 36, in <module> from twisted.internet.stdio import StandardIO, PipeAddress File "f:\myproj~1\scrapy\lib\site-packages\twisted\internet\stdio.py", line 30, in <module> from twisted.internet import _win32stdio File "f:\myproj~1\scrapy\lib\site- packages\twisted\internet\_win32stdio.py", line 9, in <module> import win32api ImportError: No module named win32api
(scrapy)F:\My Projects\scrapy\Scripts\tutorial>scrapy crawl quotes 2016-11-05 14:21:59[scrapy]信息:scrapy 1.2.1已启动(机器人:教程) 2016-11-05 14:21:59[scrapy]信息:覆盖的设置:{'NEWSPIDER_模块':'tutorial.SPIDER','SPIDER_模块':['tutorial.SPIDER'],'ROBOTSTXT_-obe':True,'BOT_-NAME':'tutorial'} 2016-11-05 14:21:59[scrapy]信息:启用的扩展名:'scrapy.extensions.logstats.logstats','scrapy.extensions.telnet.Telne tConsole','scrapy.extensions.corestats.corestats']延迟中未处理的错误: 2016-11-05 14:21:59[twisted]严重:延迟中未处理的错误: 2016-11-05 14:21:59[扭曲]关键: 回溯(最近一次呼叫最后一次): 文件“f:\myproj~1\scrapy\lib\site packages\twisted\internet\defer.py”,第12行,第60行,在_inlinecallbacksresult=g.send(result)中 文件“f:\myproj~1\scrapy\lib\site packages\scrapy\crawler.py”,第90行,在crawl six.reraise(*exc\u info) 文件“f:\myproj~1\scrapy\lib\site packages\scrapy\crawler.py”,第72行,在crawl self.engine=self.\u create\u engine()中 文件“f:\myproj~1\scrapy\lib\site packages\scrapy\crawler.py”,第97行,在创建引擎返回执行引擎(self,lambda:self.stop()中) 文件“f:\myproj~1\scrapy\lib\site packages\scrapy\core\engine.py”,第68行,在\uuuuu init\uuuuuu self.downloader=downloader\u cls(爬虫程序)中 文件“f:\myproj~1\scrapy\lib\site-packages\scrapy\core\downloader\\uuu init\uuu.py” ,第88行,在uuu init_uuuuself.middleware=DownloaderMiddlewareManager.from_crawler(crawler) 文件“f:\myproj~1\scrapy\lib\site packages\scrapy\middleware.py”,第58行,from_crawler返回cls.from_设置(crawler.settings,crawler) 文件“f:\myproj~1\scrapy\lib\site packages\scrapy\middleware.py”,第34行,from\u settings mwcls=load\u object(clspath) 文件“f:\myproj~1\scrapy\lib\site packages\scrapy\utils\misc.py”,第44行,在load\u object mod=import\u模块(模块)中 文件“c:\python27\Lib\importlib\\uuuuu init\uuuuuuuu.py”,第37行,在导入模块\uuuuuuuuuu导入\uuuuuuuu中(名称) 文件“f:\myproj~1\scrapy\lib\site-packages\scrapy\downloadermiddleware\retry.py”,第23行,from scrapy.xlib.tx导入响应文件 文件“f:\myproj~1\scrapy\lib\site packages\scrapy\xlib\tx\\ uuuu init\uuuu.py”,第3行,从twisted.web导入客户端导入 文件“f:\myproj~1\scrapy\lib\site packages\twisted\web\client.py”,第42行,从twisted.internet.endpoints导入TCP4ClientEndpoint,SSL4ClientEndpoint 文件“f:\myproj~1\scrapy\lib\site packages\twisted\internet\endpoints.py”,第36行,来自twisted.internet.stdio导入标准IO,管道地址 文件“f:\myproj~1\scrapy\lib\site packages\twisted\internet\stdio.py”,第30行,from twisted.internet import\u win32stdio 导入win32api中的文件“f:\myproj~1\scrapy\lib\site-packages\twisted\internet\\u win32stdio.py”,第9行 ImportError:没有名为win32api的模块
虚拟环境中我的pip列表是
属性==16.2.0
cffi==1.8.3
持续==15.1.0
加密==1.5.2
cssselect==1.0.0
enum34==1.1.6
idna==2.1
增量==16.10.1
ipaddress==1.0.17
lxml==3.6.4
parsel==1.0.3
pyasn1==0.1.9
pyasn1模块==0.0.8
pycparser==2.17
PyDispatcher==2.0.5
pyOpenSSL==16.2.0
queuelib==1.4.2
刮痕==1.2.1
服务标识==16.0.0
六==1.10.0
扭曲==16.5.0
w3lib==1.15.0
zope.interface==4.3.2
似乎缺少win32api,只需通过pip安装即可:
pip install pypiwin32
似乎缺少win32api,只需通过pip安装即可:
pip install pypiwin32
嘿,你知道win32api(通过pypiwin32安装)和我从sourceforge下载的pywin32是否本质上是一样的吗?这样我就不会再犯错误了?只是问一下,因为pywin32在Scrapy安装页面上被认为是必不可少的。谢谢你的帮助@CraigDsouza是的,本质上是一样的
pypiwin32
就是在pypi
(PYthon包索引)上调用它的方式,您可以从中下载并使用pip
包管理系统构建它。嘿,知道win32api(通过pypiwin32安装)和我从sourceforge下载的pywin32本质上是一样的吗?这样我就不会再犯错误了?只是问一下,因为pywin32在Scrapy安装页面上被认为是必不可少的。谢谢你的帮助@CraigDsouza是的,本质上是一样的pypiwin32
就是在pypi
(PYthon包索引)上调用它的方式,您可以从中下载并使用pip
包管理系统构建它。