Python 2.7 如何将系统命令行参数传递给Scrapy CrawlerProcess?

Python 2.7 如何将系统命令行参数传递给Scrapy CrawlerProcess?,python-2.7,scrapy,Python 2.7,Scrapy,我有一个Scrapy spider,我使用Scrapy crawl命令将系统参数传递给它。我正在尝试使用CrawlerProcess而不是命令行来运行这个爬行器。如何将所有相同的命令行参数传递到此爬虫进程? scrapy爬网示例-o data.jl-t jsonlines-s JOBDIR=/crawlstate from scrapy.crawler import CrawlerProcess from scrapy.utils.project import get_project_setti

我有一个Scrapy spider,我使用Scrapy crawl命令将系统参数传递给它。我正在尝试使用CrawlerProcess而不是命令行来运行这个爬行器。如何将所有相同的命令行参数传递到此爬虫进程?
scrapy爬网示例-o data.jl-t jsonlines-s JOBDIR=/crawlstate

from scrapy.crawler import CrawlerProcess
from scrapy.utils.project import get_project_settings
process = CrawlerProcess(get_project_settings())
process.crawl(#How do I Pass arguments like -o data.jl -t jsonlines -s 
JOBDIR=/crawlstate here?)
process.start()

您可以在将项目设置传递给
CrawlerProcess
constructor之前修改它们:

...
settings = get_project_settings()
settings.set('FEED_URI', 'data.jl', priority='cmdline')
settings.set('FEED_FORMAT', 'jsonlines', priority='cmdline')
settings.set('JOBDIR', '/crawlstate', priority='cmdline')
process = CrawlerProcess(settings)
...