Python 503使用scrapy时服务不可用

我想删除它。但我得到一个错误503服务不可用。这是我的代码：

import scrapy
from scrapy.linkextractors import LinkExtractor
from scrapy.spiders import CrawlSpider, Rule


class HarisSpider(CrawlSpider):
    name = 'haris'
    start_urls = ['https://www.gumtree.com.au/s-cars-vans-utes/c18320']

    rules = (
        Rule(LinkExtractor(restrict_xpaths="//div[@class='user-ad-collection-new-design__wrapper--row']/a"), callback='parse_item', follow=True),
    )

    def parse_item(self, response):
        print(response.url)
        yield{
            'Url' : response.request.url,
            'Name':response.xpath("//h1/text()").get(),
            'Price':response.xpath("//span[@class='user-ad-price__price']/text()").get(),
            'Seller_Type':response.xpath("//ul[@class='vip-ad-attributes__list']/li[3]/span[2]/text()").get(),
            'Make':response.xpath("//ul[@class='vip-ad-attributes__list']/li[4]/a/text()").get(),
            'Model':response.xpath("//ul[@class='vip-ad-attributes__list']/li[5]/a/text()").get(),
            'Variant':response.xpath("//ul[@class='vip-ad-attributes__list']/li[6]/span[2]/text()").get(),
            'Body_Type':response.xpath("//ul[@class='vip-ad-attributes__list']/li[9]/a/text()").get(),
            'Year':response.xpath("//ul[@class='vip-ad-attributes__list']/li[10]/a/text()").get(),
            'Kilometer':response.xpath("//ul[@class='vip-ad-attributes__list']/li[11]/span[2]/text()").get(),
            'Transmission':response.xpath("//ul[@class='vip-ad-attributes__list']/li[12]/span[2]/text()").get(),
            'Drive_Train':response.xpath("//ul[@class='vip-ad-attributes__list']/li[13]/span[2]/text()").get(),
            'Fuel_Type':response.xpath("//ul[@class='vip-ad-attributes__list']/li[14]/span[2]/text()").get(),
            'Color':response.xpath("//ul[@class='vip-ad-attributes__list']/li[15]/span[2]/text()").get(),
            'Air_Conditioning':response.xpath("//ul[@class='vip-ad-attributes__list']/li[16]/span[2]/text()").get(),
            'Stock_Number':response.xpath("//ul[@class='vip-ad-attributes__list']/li[17]/span[2]/text()").get(),
            'VIN':response.xpath("//ul[@class='vip-ad-attributes__list']/li[18]/span[2]/text()").get(),
            'Registration_Number':response.xpath("//ul[@class='vip-ad-attributes__list']/li[20]/span[2]/text()").get()
        
        }

得到这个错误：

2020-11-02 01:36:00 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://www.gumtree.com.au/s-ad/fairfield-west/cars-vans-utes/kia-optima-2012/1260433859> (failed 1 times): 503 Service Unavailable

2020-11-02 01:36:00[scrapy.downloadermiddleware.retry]调试：重试（失败1次）：503服务不可用

谁能解决这个问题？提前感谢

您需要控制请求频率。看见首先在

parse_item

中添加一个短睡眠-它解决了503问题吗？