Warning: file_get_contents(/data/phpspider/zhask/data//catemap/2/python/315.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Python 用scrapy搜索网站上的所有评论_Python_Scrapy - Fatal编程技术网

Python 用scrapy搜索网站上的所有评论

Python 用scrapy搜索网站上的所有评论,python,scrapy,Python,Scrapy,我试图用Scrapy抓取购物网站上的所有评论。我发现这个代码: import scrapy from scrapy.spiders import CrawlSpider, Rule from scrapy.linkextractors import LinkExtractor class deneme(CrawlSpider): name = 'deneme' allowed_domains = ['hepsiburada.com'] start_urls = ['https://www.he

我试图用Scrapy抓取购物网站上的所有评论。我发现这个代码:

import scrapy
from scrapy.spiders import CrawlSpider, Rule
from scrapy.linkextractors import LinkExtractor

class deneme(CrawlSpider):
name = 'deneme'
allowed_domains = ['hepsiburada.com']
start_urls = ['https://www.hepsiburada.com/']

rules = (
    Rule(LinkExtractor(), callback='parse_item', follow=True),
)

def parse_item(self, response):
    filename = response.url.split("/")[-2] + '.html'
    with open(filename, 'wb') as f:
        f.write(response.body)
此代码爬网整个网站。但我只想抓取网站上的评论,并将其写入MongoDB数据库。我不擅长Python。我该怎么做?谢谢大家!

以下是代码:

import scrapy
from scrapy.spiders import CrawlSpider, Rule
from scrapy.linkextractors import LinkExtractor

class deneme(CrawlSpider):
    name = 'yorum'
    allowed_domains = ['hepsiburada.com']
    start_urls = ['https://www.hepsiburada.com/']
    rules = (
        Rule(LinkExtractor(), callback='parse_item', follow=True),
    )


    def parse_item(self, response):




        print(response.xpath('//p[@class="review-text"]/text()').extract())

你在回答自己的问题吗?