Python 3.x Scrapy无法获取页面上的所有项目

我正试图修改的代码，从一个问答网站刮的问题

import scrapy

class MySpider(scrapy.Spider):
    name = "foo"
    start_urls = ['https://www.hello.com']

    def parse(self, response):
        SET_SELECTOR = '.pagedlist_item'
        for foo in response.css(SET_SELECTOR):

            NAME_SELECTOR = '.question_link ::attr(href)'
            yield {
                'name': foo.css(NAME_SELECTOR).extract_first(),
            }

我正在抓取的页面中的对象被划分为

pagedlist\u item

类

每个类都包含我需要的URL作为

question\u链接

classes

上面的代码确实有效，但在20+项中只保留了约10项：

2020-11-06 00:57:59 [scrapy.core.engine] INFO: Spider opened
2020-11-06 00:57:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-11-06 00:57:59 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2020-11-06 00:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.hello.com/search?q=airsoft> (referer: None)
2020-11-06 00:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.hello.com/search?q=airsoft>
{'name': '/Airsoft-vs-paintball-where-does-it-hurt-more-to-get-hit'}
2020-11-06 00:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.hello.com/search?q=airsoft>
{'name': '/What-would-be-the-best-all-purpose-airsoft-gun'}
2020-11-06 00:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.hello.com/search?q=airsoft>
{'name': '/Can-airsoft-weapons-be-deadly'}
2020-11-06 00:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.hello.com/search?q=airsoft>
{'name': '/Why-does-Australia-still-ban-airsoft-guns'}
2020-11-06 00:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.hello.com/search?q=airsoft>
{'name': '/How-many-types-of-airsoft-guns-are-there'}
2020-11-06 00:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.hello.com/search?q=airsoft>
{'name': '/What-is-the-best-place-to-buy-quality-airsoft-guns-online'}
2020-11-06 00:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.hello.com/search?q=airsoft>
{'name': '/What-does-your-Airsoft-gun-look-like'}
2020-11-06 00:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.hello.com/search?q=airsoft>
{'name': '/Whats-better-going-paintballing-or-airsoft-Why'}
2020-11-06 00:58:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.hello.com/search?q=airsoft>
{'name': '/What-are-top-tips-for-first-time-Airsofters'}
2020-11-06 00:58:01 [scrapy.core.engine] INFO: Closing spider (finished)

2020-11-06 00:57:59[scrapy.core.engine]信息：卡盘已打开
2020-11-06 00:57:59[scrapy.extensions.logstats]信息：爬网0页（0页/分钟），爬网0项（0项/分钟）
2020-11-06 00:57:59[scrapy.extensions.telnet]信息：telnet控制台监听127.0.0.1:6023
2020-11-06 00:58:00[scrapy.core.engine]调试：爬网（200）（参考：无）
2020-11-06 00:58:01[scrapy.core.scraper]调试：从
{'name'：'/Airsoft vs paintball在哪里被击中更痛}
2020-11-06 00:58:01[scrapy.core.scraper]调试：从
{'name'：'/什么是最好的通用软空气枪}
2020-11-06 00:58:01[scrapy.core.scraper]调试：从
{'name'：'/软空气武器会致命吗}
2020-11-06 00:58:01[scrapy.core.scraper]调试：从
{'name'：'/为什么澳大利亚仍然禁止气枪'
2020-11-06 00:58:01[scrapy.core.scraper]调试：从
{'name'：'/有多少种软空气枪}
2020-11-06 00:58:01[scrapy.core.scraper]调试：从
{'name'：'/网上购买优质软空气枪的最佳地点是哪里}
2020-11-06 00:58:01[scrapy.core.scraper]调试：从
{'name'：'/你的气枪看起来像什么}
2020-11-06 00:58:01[scrapy.core.scraper]调试：从
{'name'：'/有什么比玩彩弹或气枪更好？为什么}
2020-11-06 00:58:01[scrapy.core.scraper]调试：从
{'name'：'/第一次使用Airsofters'的最佳技巧是什么}
2020-11-06 00:58:01[刮屑堆芯发动机]信息：关闭卡盘（已完成）

建议