Warning: file_get_contents(/data/phpspider/zhask/data//catemap/4/video/2.json): failed to open stream: No such file or directory in /data/phpspider/zhask/libs/function.php on line 167

Warning: Invalid argument supplied for foreach() in /data/phpspider/zhask/libs/tag.function.php on line 1116

Notice: Undefined index: in /data/phpspider/zhask/libs/function.php on line 180

Warning: array_chunk() expects parameter 1 to be array, null given in /data/phpspider/zhask/libs/function.php on line 181
Python 多个爬行器连续执行_Python_Selenium_Web Scraping_Scrapy - Fatal编程技术网

Python 多个爬行器连续执行

Python 多个爬行器连续执行,python,selenium,web-scraping,scrapy,Python,Selenium,Web Scraping,Scrapy,我有一个棘手的项目。我已经将spider与SeleniumWebDriver集成在一起,代码如下所示 def start(i): //do some navigation with selenium webdriver return url class abc(BaseSpider): name = '123' x = start(5) start_urls = [x] def parse(self, response): /

我有一个棘手的项目。我已经将spider与SeleniumWebDriver集成在一起,代码如下所示

def start(i):
    //do some navigation with selenium webdriver

    return url

class abc(BaseSpider):
    name = '123'
    x = start(5)
    start_urls = [x]
    def parse(self, response):

        // scrape data.


class fgh(BaseSpider):
    name = '456'
    x = start(8)
    start_urls = [x]
    def parse(self, response):

        // scrape data.

.... and so on {20 classes as such}..

现在,每当我尝试“刮屑爬行456”时,它都会从第一个爬行器“123”开始执行。控制权未转移到相应的卡盘。我不熟悉硒和刮痧。请帮忙。

实际上,它是用
.pyc
文件写的。我删除了它,现在它运行良好