Python 什么';这是什么意思

Python 什么';这是什么意思,python,scrapy,Python,Scrapy,比如说 2016-01-07 11:37:19 [scrapy] INFO: Crawled 61 pages (at 61 pages/min), scraped 0 items (at 0 items/min) 2016-01-07 11:38:19 [scrapy] INFO: Crawled 171 pages (at 110 pages/min), scraped 0 items (at 0 items/min) 2016-01-07 11:39:19 [scrapy] INFO: C

比如说

2016-01-07 11:37:19 [scrapy] INFO: Crawled 61 pages (at 61 pages/min), scraped 0 items (at 0 items/min)
2016-01-07 11:38:19 [scrapy] INFO: Crawled 171 pages (at 110 pages/min), scraped 0 items (at 0 items/min)
2016-01-07 11:39:19 [scrapy] INFO: Crawled 299 pages (at 128 pages/min), scraped 0 items (at 0 items/min)
2016-01-07 11:40:19 [scrapy] INFO: Crawled 394 pages (at 95 pages/min), scraped 0 items (at 0 items/min)
2016-01-07 11:41:19 [scrapy] INFO: Crawled 487 pages (at 93 pages/min), scraped 0 items (at 0 items/min)
2016-01-07 11:42:19 [scrapy] INFO: Crawled 554 pages (at 67 pages/min), scraped 0 items (at 0 items/min)
2016-01-07 11:43:19 [scrapy] INFO: Crawled 616 pages (at 62 pages/min), scraped 0 items (at 0 items/min)
2016-01-07 11:44:19 [scrapy] INFO: Crawled 743 pages (at 127 pages/min), scraped 0 items (at 0 items/min)
  • “爬行”、“刮”是什么意思
  • 当scrapy将打印日志时,例如“爬网743页(127页/分钟)、刮取0项(0项/分钟)”,此时调用哪个函数
  • 爬网页面是一个爬行器请求的页面。它也应该解析它,这取决于你是如何编程的。刮取的项是从该解析中提取的一组数据。这两个都在scrapy教程中进行了解释:和

  • 我不太确定,但如果我没记错的话,这是蜘蛛完成任务后打印出来的


  • 当您的函数<代码>产生项目可能重复时,项目被刮除