Python 刮擦错误:没有模块命名项
我想爬虫网站 但当我使用命令爬虫时Python 刮擦错误:没有模块命名项,python,linux,terminal,scrapy,web-crawler,Python,Linux,Terminal,Scrapy,Web Crawler,我想爬虫网站 但当我使用命令爬虫时 scrapy crawl metacritic -o metacritic.json -t json 上面写着ImportError:没有模块命名的项目 有人能帮忙吗 metacritic_spider.py来源: from scrapy.spider import BaseSpider from scrapy.selector import HtmlXPathSelector from metacritic.items import MetacriticI
scrapy crawl metacritic -o metacritic.json -t json
上面写着ImportError:没有模块命名的项目
有人能帮忙吗
metacritic_spider.py来源:
from scrapy.spider import BaseSpider
from scrapy.selector import HtmlXPathSelector
from metacritic.items import MetacriticItem
class MetacriticSpider(BaseSpider):
class MetacriticSpider(BaseSpider):
name = "metacritic" # Name of the spider, to be used when crawling
allowed_domains = ["metacritic.com"] # Where the spider is allowed to go
start_urls = ["http://www.metacritic.com/browse/games/title/pc?page=0"]
def parse(self, response):
hxs = HtmlXPathSelector(response) # The XPath selector
sites = hxs.select('//li[contains(@class, "product game_product")]/div[@class="product_wrap"]')
items = []
for site in sites:
item = MetacriticItem()
item['title'] = site.select('div[@class="basic_stat product_title"]/a/text()').extract()
item['link'] = site.select('div[@class="basic_stat product_title"]/a/@href').extract()
item['cscore'] = site.select('div[@class="basic_stat product_score brief_metascore"]/div/div/span[contains(@class, "data metascore score")]/text()').extract()
item['uscore'] = site.select('div[@class="more_stats condensed_stats"]/ul/li/span[contains(@class, "data textscore textscore")]/text()').extract()
item['date'] = site.select('div[@class="more_stats condensed_stats"]/ul/li/span[@class="data"]/text()').extract()
items.append(item)
return items
source item.py:
from scrapy.item import Item, Field
class MetacriticItem(Item):
# Here are the fields that will be crawled and stored
title = Field() # Game title
link = Field() # Link to individual game page
cscore = Field() # Critic score
uscore = Field() # User score
date = Field() # Release date
我的目录结构:将你的
item.py
移动到第二个metacritic
文件夹中。我的结构目录:metacritic我认为格式应该是固定的。我试着改变这一点,不知道为什么我的评论不被接受。你有facebook的bryans吗?也许你可以从中得到答案我没有答案给你。我更关心的是如何让帖子正确地显示代码,以便更多的人能够看到它