Python Scrapy NotImplemented解析错误，尽管继承自爬行蜘蛛

我正试着让一个非常简单的刮擦爬虫工作。我从解析中得到一个NotImplemented错误-本质上与此问题相同：

除了我是从爬行蜘蛛那里继承的

我差不多一字不差地看了这一页：

要生成此代码：

import scrapy
from scrapy.contrib.spiders import CrawlSpider, Rule
from scrapy.contrib.linkextractors import LinkExtractor


class SiteSpider(CrawlSpider):

    name = 'sdreader'
    allowed_domains = ['sandiegoreader.com']
    start_urls = ['http://www.sandiegoreader.com/events/all/']
    rules = [Rule(LinkExtractor(allow=['/events/2015/.+', '/events/ongoing/.+']), 'parse_event')]

    def parse_event(self, response):
        event = EventItem()
        event['name'] = response.xpath('//*[@id="content"]/div[2]/h2/text()').extract()
        return event

我在日志中记下：

2015-04-12 15:01:07-0700 [scrapy] INFO: Scrapy 0.24.5 started (bot: sdreader)
2015-04-12 15:01:07-0700 [scrapy] INFO: Optional features available: ssl, http11
2015-04-12 15:01:07-0700 [scrapy] INFO: Overridden settings: {'NEWSPIDER_MODULE': 'sdreader.spiders', 'SPIDER_MODULES': ['sdreader.spiders'], 'DEPTH_LIMIT': 1, 'DOWNLOAD_DELAY': 2, 'BOT_NAME': 'sdreader'}
2015-04-12 15:01:07-0700 [scrapy] INFO: Enabled extensions: LogStats, TelnetConsole, CloseSpider, WebService, CoreStats, SpiderState
2015-04-12 15:01:07-0700 [scrapy] INFO: Enabled downloader middlewares: HttpAuthMiddleware, DownloadTimeoutMiddleware, UserAgentMiddleware, RetryMiddleware, DefaultHeadersMiddleware, MetaRefreshMiddleware, HttpCompressionMiddleware, RedirectMiddleware, CookiesMiddleware, ChunkedTransferMiddleware, DownloaderStats
2015-04-12 15:01:07-0700 [scrapy] INFO: Enabled spider middlewares: HttpErrorMiddleware, DeltaFetch, OffsiteMiddleware, RefererMiddleware, UrlLengthMiddleware, DepthMiddleware
2015-04-12 15:01:07-0700 [scrapy] INFO: Enabled item pipelines:
2015-04-12 15:01:07-0700 [sdreader] INFO: Spider opened
2015-04-12 15:01:07-0700 [sdreader] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2015-04-12 15:01:07-0700 [scrapy] DEBUG: Telnet console listening on 127.0.0.1:6023
2015-04-12 15:01:07-0700 [scrapy] DEBUG: Web service listening on 127.0.0.1:6080
2015-04-12 15:01:24-0700 [sdreader] DEBUG: Crawled (200) <GET http://www.sandiegoreader.com/events/all/> (referer: None)
2015-04-12 15:01:24-0700 [sdreader] ERROR: Spider error processing <GET http://www.sandiegoreader.com/events/all/>
    Traceback (most recent call last):
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/base.py", line 1178, in mainLoop
        self.runUntilCurrent()
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/base.py", line 800, in runUntilCurrent
        call.func(*call.args, **call.kw)
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/defer.py", line 368, in callback
        self._startRunCallbacks(result)
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/defer.py", line 464, in _startRunCallbacks
        self._runCallbacks()
    --- <exception caught here> ---
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/defer.py", line 551, in _runCallbacks
        current.result = callback(current.result, *args, **kw)
      File "/Library/Python/2.7/site-packages/scrapy/spider.py", line 56, in parse
        raise NotImplementedError
    exceptions.NotImplementedError:

2015-04-12 15:01:24-0700 [sdreader] INFO: Closing spider (finished)
2015-04-12 15:01:24-0700 [sdreader] ERROR: Error caught on signal handler: <bound method ?.spider_closed of <sdreader.middlewares.deltafetch.DeltaFetch object at 0x105167410>>
    Traceback (most recent call last):
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/defer.py", line 551, in _runCallbacks
        current.result = callback(current.result, *args, **kw)
      File "/Library/Python/2.7/site-packages/scrapy/core/engine.py", line 275, in <lambda>
        spider=spider, reason=reason, spider_stats=self.crawler.stats.get_stats()))
      File "/Library/Python/2.7/site-packages/scrapy/signalmanager.py", line 23, in send_catch_log_deferred
        return signal.send_catch_log_deferred(*a, **kw)
      File "/Library/Python/2.7/site-packages/scrapy/utils/signal.py", line 53, in send_catch_log_deferred
        *arguments, **named)
    --- <exception caught here> ---
      File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twisted/internet/defer.py", line 134, in maybeDeferred
        result = f(*args, **kw)
      File "/Library/Python/2.7/site-packages/scrapy/xlib/pydispatch/robustapply.py", line 54, in robustApply
        return receiver(*arguments, **named)
      File "/Users/jasonyau/events/weekendr-db/sdreader/scrapy/sdreader/sdreader/middlewares/deltafetch.py", line 65, in spider_closed
        self.db.close()
      File "/Library/Python/2.7/site-packages/pymongo/collection.py", line 1705, in __call__
        self.__name)
    exceptions.TypeError: 'Collection' object is not callable. If you meant to call the 'close' method on a 'Database' object it is failing because no such method exists.

2015-04-12 15:01:24-0700 [sdreader] INFO: Dumping Scrapy stats:
    {'downloader/request_bytes': 232,
     'downloader/request_count': 1,
     'downloader/request_method_count/GET': 1,
     'downloader/response_bytes': 114076,
     'downloader/response_count': 1,
     'downloader/response_status_count/200': 1,
     'finish_reason': 'finished',
     'finish_time': datetime.datetime(2015, 4, 12, 22, 1, 24, 154684),
     'log_count/DEBUG': 3,
     'log_count/ERROR': 2,
     'log_count/INFO': 7,
     'response_received_count': 1,
     'scheduler/dequeued': 1,
     'scheduler/dequeued/memory': 1,
     'scheduler/enqueued': 1,
     'scheduler/enqueued/memory': 1,
     'spider_exceptions/NotImplementedError': 1,
     'start_time': datetime.datetime(2015, 4, 12, 22, 1, 7, 718810)}
2015-04-12 15:01:24-0700 [sdreader] INFO: Spider closed (finished)

2015-04-12 15:01:07-0700[scrapy]信息：scrapy 0.24.5已启动（bot:sdreader）
2015-04-12 15:01:07-0700[scrapy]信息：可选功能可用：ssl、http11
2015-04-12 15:01:07-0700[scrapy]信息：覆盖的设置：{'NEWSPIDER_模块'：'sdreader.SPIDER'，'SPIDER_模块'：['sdreader.SPIDER'，'DEPTH_LIMIT'，'DEPTH_LIMIT'：1，'DOWNLOAD_DELAY'：2，'BOT_NAME'：'sdreader'}
2015-04-12 15:01:07-0700[scrapy]信息：启用的扩展：LogStats、TelnetConsole、CloseSpider、WebService、CoreStats、SpiderState
2015-04-12 15:01:07-0700[scrapy]信息：启用的下载中间件：HttpAuthMiddleware、DownloadTimeoutMiddleware、UserAgentMiddleware、RetryMiddleware、DefaultHeadersMiddleware、MetaRefreshMiddleware、HttpCompressionMiddleware、RedirectMiddleware、Cookies Middleware、ChunkedTransferMiddleware、DownloadersStats
2015-04-12 15:01:07-0700[scrapy]信息：启用的蜘蛛中间件：HttpErrorMiddleware、DeltaFetch、OffsiteMiddleware、RefererMiddleware、UrlLengthMiddleware、DepthMiddleware
2015-04-12 15:01:07-0700[scrapy]信息：启用的项目管道：
2015-04-12 15:01:07-0700[sdreader]信息：蜘蛛网已打开
2015-04-12 15:01:07-0700[sdreader]信息：抓取0页（以0页/分钟的速度），抓取0项（以0项/分钟的速度）
2015-04-12 15:01:07-0700[scrapy]调试：Telnet控制台监听127.0.0.1:6023
2015-04-12 15:01:07-0700[scrapy]调试：在127.0.0.1:6080上侦听Web服务
2015-04-12 15:01:24-0700[sdreader]调试：爬网（200）（参考：无）
2015-04-12 15:01:24-0700[sdreader]错误：蜘蛛错误处理
回溯（最近一次呼叫最后一次）：
mainLoop中的文件“/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/Python/twisted/internet/base.py”，第1178行
self.rununtlcurrent（）
文件“/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/Python/twisted/internet/base.py”，第800行，在rununtlcurrent中
call.func（*call.args，**call.kw）
文件“/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/Python/twisted/internet/defer.py”，第368行，在回调中
自启动返回（结果）
文件“/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/Python/twisted/internet/defer.py”，第464行，在startRunCallbacks中
self.\u runCallbacks（）
---  ---
文件“/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/Python/twisted/internet/defer.py”，第551行，在runCallbacks中
current.result=回调（current.result，*args，**kw）
文件“/Library/Python/2.7/site packages/scrapy/spider.py”，第56行，在解析中
引发未实现的错误
异常。未实现错误：
2015-04-12 15:01:24-0700[sdreader]信息：关闭卡盘（已完成）
2015-04-12 15:01:24-0700[sdreader]错误：在信号处理器上捕获错误：
回溯（最近一次呼叫最后一次）：
文件“/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/Python/twisted/internet/defer.py”，第551行，在runCallbacks中
current.result=回调（current.result，*args，**kw）
文件“/Library/Python/2.7/site packages/scrapy/core/engine.py”，第275行，在
spider=spider，reason=reason，spider\u stats=self.crawler.stats.get\u stats（））
文件“/Library/Python/2.7/site packages/scrapy/signalmanager.py”，第23行，在send\u catch\u log\u中
返回信号。发送捕获日志延迟（*a，**kw）
文件“/Library/Python/2.7/site packages/scrapy/utils/signal.py”，第53行，在send\u catch\u log\u中
*参数，**已命名）
---  ---
文件“/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/Python/twisted/internet/defer.py”，第134行，格式为maybeDeferred
结果=f（*参数，**kw）
文件“/Library/Python/2.7/site packages/scrapy/xlib/pydispatch/robustapply.py”，第54行，在robustapply中
返回接收器（*参数，**已命名）
文件“/Users/jasonyau/events/weekendr db/sdreader/scrapy/sdreader/sdreader/middleware/deltafetch.py”，第65行，在spider_中关闭
self.db.close（）
文件“/Library/Python/2.7/site packages/pymongo/collection.py”，第1705行，在调用中__
自我（姓名）
exceptions.TypeError:“Collection”对象不可调用。如果要对“数据库”对象调用“close”方法，则会失败，因为不存在此类方法。
2015-04-12 15:01:24-0700[sdreader]信息：倾倒垃圾统计数据：
{'downloader/request_bytes'：232，
“下载程序/请求计数”：1，
“downloader/request\u method\u count/GET”：1，
“downloader/response_字节”：114076，
“下载程序/响应计数”：1，
“下载程序/响应状态\计数/200”：1，
“完成原因”：“完成”，
“完成时间”：datetime.datetime（2015,4,12,22,1,24,154684），
“日志计数/调试”：3，
“日志计数/错误”：2，
“日志计数/信息”：7，
“响应\u已接收\u计数”：1，
“调度程序/出列”：1，
“调度程序/出列/内存”：1，
“调度程序/排队”：1，
“调度程序/排队/内存”：1，
“spider_异常/未实现错误”：1，
“开始时间”：datetime.datetime（2015,4,12,22,1,7718810）}
2015-04-12 15:01:24-0700[sdreader]信息：蜘蛛侠关闭（完成）

---

一定是某个地方的用户错误。我已经调查了爬行蜘蛛的来源，它似乎达到了我的预期。它正在实现对Spider的解析和继承。

尝试将

规则中的回调函数更改为：

rules = [Rule(LinkExtractor(allow=['/events/2015/.+', '/events/ongoing/.+']), self.parse_event)]

解决了。这让我走上了正确的道路。在引号中包装self.parse_事件起了作用，然后又出现了另一个错误，我通过谷歌搜索发现我被重写的init函数没有调用super，causi