Python 碎片DNS查找错误
当我尝试对以下URL进行爬网时,会出现DNS查找错误。网址: 错误:Python 碎片DNS查找错误,python,dns,scrapy,Python,Dns,Scrapy,当我尝试对以下URL进行爬网时,会出现DNS查找错误。网址: 错误: DNS lookup failed: address 'http://extremecouponprofessors.net/2012/03/anyone-get-cash-in-the-mail-today-im-not-kidding-i-got-cash-lol/' not found: timeout error. 当访问w/scrapy shell时,我得到了相同的错误 scrapy shell "http://e
DNS lookup failed: address 'http://extremecouponprofessors.net/2012/03/anyone-get-cash-in-the-mail-today-im-not-kidding-i-got-cash-lol/' not found: timeout error.
当访问w/scrapy shell时,我得到了相同的错误
scrapy shell "http://extremecouponprofessors.net/2012/03/anyone-get-cash-in-the-mail-today-im-not-kidding-i-got-cash-lol/"
刮壳错误:
elif failure.check(DNSLookupError): SyntaxError: invalid syntax
挖掘extremecouponprofessors.net:
; <<>> DiG 9.8.3-P1 <<>> extremecouponprofessors.net
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 9017
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION:
;extremecouponprofessors.net. IN A
;; ANSWER SECTION:
extremecouponprofessors.net. 4563 IN A 198.136.50.148
;; Query time: 7 msec
;; SERVER: 192.168.101.7#53(192.168.101.7)
;; WHEN: Wed Nov 18 16:12:00 2015
;; MSG SIZE rcvd: 61
;挖掘9.8.3-P1 extremecoupon.net
;; 全局选项:+cmd
;; 得到答案:
;; ->>headeras假设主机操作系统是Linux,那么运行爬虫程序的主机的dig extremecouponprofessors.net
输出是什么?如果这不是Linux,请使用适用于该操作系统的DNS解析器工具。@SashaPachev运行dig--它可以解析。我收到了一个200响应,您的scrapy命令将verbatum粘贴到终端中。尝试strace-f-o/tmp/strace.out-s4096刮壳“刮壳”http://extremecouponprofessors.net/2012/03/anyone-get-cash-in-the-mail-today-im-not-kidding-i-got-cash-lol/“
,然后使“/tmp/strace.out”在某个地方可用。@SashaPachev对不起-OSX与strace--dtrace的等价物是什么?