我正在尝试用python进行web抓取,我一次又一次地遇到这些错误
这是我的密码我正在尝试用python进行web抓取,我一次又一次地遇到这些错误,python,beautifulsoup,python-requests,screen-scraping,python-webbrowser,Python,Beautifulsoup,Python Requests,Screen Scraping,Python Webbrowser,这是我的密码 import bs4 import requests res = requests.get('https://www.anywebsite.com/home') soup = bs4.BeautifulSoup(res.text, 'json') table_body=soup.find('tbody') rows = table_body.find_all('tr') for row in rows: cols=row.find_all('td') cols=
import bs4
import requests
res = requests.get('https://www.anywebsite.com/home')
soup = bs4.BeautifulSoup(res.text, 'json')
table_body=soup.find('tbody')
rows = table_body.find_all('tr')
for row in rows:
cols=row.find_all('td')
cols=[x.text.strip() for x in cols]
print (cols)
下面是我得到的这些错误:
File "C:\Users\ahsan\Anaconda3\lib\site-packages\requests\adapters.py", line 449, in send
timeout=timeout
File "C:\Users\ahsan\Anaconda3\lib\site-packages\urllib3\connectionpool.py", line 638, in urlopen
_stacktrace=sys.exc_info()[2])
File "C:\Users\ahsan\Anaconda3\lib\site-packages\urllib3\util\retry.py", line 398, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='www.anywebsite.info', port=443): Max retries exceeded with url: /data/ (Caused by SSLError("Can't connect to HTTPS URL
because the SSL module is not available."))
在处理上述异常期间,发生了另一个异常:
Traceback (most recent call last):
File "c:/Users/ahsan/Desktop/python_work/data.py", line 3, in <module>
res = requests.get('https://www.anywebsit.com/home')
File "C:\Users\ahsan\Anaconda3\lib\site-packages\requests\api.py", line 75, in get
return request('get', url, params=params, **kwargs)
File "C:\Users\ahsan\Anaconda3\lib\site-packages\requests\api.py", line 60, in request
return session.request(method=method, url=url, **kwargs)
File "C:\Users\ahsan\Anaconda3\lib\site-packages\requests\sessions.py", line 533, in request
resp = self.send(prep, **send_kwargs)
File "C:\Users\ahsan\Anaconda3\lib\site-packages\requests\sessions.py", line 646, in send
r = adapter.send(request, **kwargs)
File "C:\Users\ahsan\Anaconda3\lib\site-packages\requests\adapters.py", line 514, in send
raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='www.anywebsite.info', port=443): Max retries exceeded with url: /data/ (Caused by SSLError("Can't connect to HTTPS URL because the SSL module is not available."))
回溯(最近一次呼叫最后一次):
文件“c:/Users/ahsan/Desktop/python_work/data.py”,第3行,在
res=requests.get('https://www.anywebsit.com/home')
get中第75行的文件“C:\Users\ahsan\Anaconda3\lib\site packages\requests\api.py”
返回请求('get',url,params=params,**kwargs)
文件“C:\Users\ahsan\Anaconda3\lib\site packages\requests\api.py”,第60行,在请求中
return session.request(method=method,url=url,**kwargs)
文件“C:\Users\ahsan\Anaconda3\lib\site packages\requests\sessions.py”,第533行,在请求中
resp=自我发送(准备,**发送)
文件“C:\Users\ahsan\Anaconda3\lib\site packages\requests\sessions.py”,第646行,在send中
r=适配器.send(请求,**kwargs)
文件“C:\Users\ahsan\Anaconda3\lib\site packages\requests\adapters.py”,第514行,在send中
raise SSLError(e,请求=请求)
requests.exceptions.SSLError:HTTPSConnectionPool(host='www.anywebsite.info',port=443):url:/data超过最大重试次数/(由SSLError引起(“由于SSL模块不可用,无法连接到HTTPS url”。)
请帮我解决这个问题
提前感谢您您是否支持代理?或者您支持代理,或者您的internet连接不是很强“无法连接到HTTPS URL,因为SSL模块不可用”。(上一个stacktrace中的最后一行。)似乎您需要安装openssl。不,我不是在proxy后面。您是在代理后面吗?或者您的internet连接不是很强“无法连接到HTTPS URL,因为SSL模块不可用”。(上一个stacktrace中的最后一行)似乎您需要安装openssl。不,我不支持代理