Python 多个爬行器连续执行
我有一个棘手的项目。我已经将spider与SeleniumWebDriver集成在一起,代码如下所示Python 多个爬行器连续执行,python,selenium,web-scraping,scrapy,Python,Selenium,Web Scraping,Scrapy,我有一个棘手的项目。我已经将spider与SeleniumWebDriver集成在一起,代码如下所示 def start(i): //do some navigation with selenium webdriver return url class abc(BaseSpider): name = '123' x = start(5) start_urls = [x] def parse(self, response): /
def start(i):
//do some navigation with selenium webdriver
return url
class abc(BaseSpider):
name = '123'
x = start(5)
start_urls = [x]
def parse(self, response):
// scrape data.
class fgh(BaseSpider):
name = '456'
x = start(8)
start_urls = [x]
def parse(self, response):
// scrape data.
.... and so on {20 classes as such}..
现在,每当我尝试“刮屑爬行456”时,它都会从第一个爬行器“123”开始执行。控制权未转移到相应的卡盘。我不熟悉硒和刮痧。请帮忙。实际上,它是用
.pyc
文件写的。我删除了它,现在它运行良好