Python 如何在代理抓取中使用While循环
因此,有时当我刮取代理时,可用代理的数量为0,如果为零,我希望这部分代码循环,直到可用检查代理的数量不为零。如果可能,请编辑代码以提供帮助,非常感谢:Python 如何在代理抓取中使用While循环,python,while-loop,proxies,Python,While Loop,Proxies,因此,有时当我刮取代理时,可用代理的数量为0,如果为零,我希望这部分代码循环,直到可用检查代理的数量不为零。如果可能,请编辑代码以提供帮助,非常感谢: def auto_scrape_and_check(): start = datetime.now() loop = asyncio.get_event_loop() ps = ProxyScraper("socks4") proxies = ps.proxyscrape_scrape()
def auto_scrape_and_check():
start = datetime.now()
loop = asyncio.get_event_loop()
ps = ProxyScraper("socks4")
proxies = ps.proxyscrape_scrape()
proxies = list(proxies) + ps.spys_proxy_scrape() + ps.proxyscan_io_scrape()
pc = ProxyChecker(proxyType="socks4", proxies=proxies) #always put http if using http/https proxies. It works for both.
loop.run_until_complete(pc.begin_checking())
pc.proxy_cleaner()
checked = pc.clean_dupe_origin_proxies()
pc.write_to_file(checked, "config/proxies.txt")
pprint(checked)
print("The proxy checking took {} seconds.".format(round((datetime.now() - start).total_seconds(), 2)))
print("Checked {} proxies.".format(len(proxies)))
print("There were {} usable proxies.".format(len(checked)))
return checked