Python 刮除可见文本
我在网络抓取领域绝对是个新手，现在我想从网页中提取可见文本。我在网上找到了一段代码：Python 刮除可见文本,python,web-scraping,beautifulsoup,urllib2,Python,Web Scraping,Beautifulsoup,Urllib2,我在网络抓取领域绝对是个新手，现在我想从网页中提取可见文本。我在网上找到了一段代码： import urllib2 from bs4 import BeautifulSoup url = "http://www.espncricinfo.com/" web_page = urllib2.urlopen(url) soup = BeautifulSoup(url , "lxml") print (soup.prettify()) 对于上述代码，我得到以下结果： /usr/local/
import urllib2
from bs4 import BeautifulSoup
url = "http://www.espncricinfo.com/"
web_page = urllib2.urlopen(url)
soup = BeautifulSoup(url , "lxml")
print (soup.prettify())
/usr/local/lib/python2.7/site-packages/bs4/__init__.py:282: UserWarning: "http://www.espncricinfo.com/" looks like a URL. Beautiful Soup is not an HTTP client. You should probably use an HTTP client like requests to get the document behind the URL, and feed that document to Beautiful Soup.
' that document to Beautiful Soup.' % decoded_markup
<html>
<body>
<p>
http://www.espncricinfo.com/
</p>
</body>
</html>
/usr/local/lib/python2.7/site-packages/bs4/__-init__u;.py:282:UserWarning:http://www.espncricinfo.com/“看起来像一个URL。Beauty Soup不是HTTP客户端。您可能应该使用类似HTTP客户端的请求来获取URL后面的文档，并将该文档提供给Beautiful Soup。
“那份文件很漂亮。”%decoded\u
http://www.espncricinfo.com/
无论如何，我可以得到一个更具体的结果，以及代码发生了什么错误。抱歉，我不清楚。请尝试将html文档而不是url传递到：
import urllib2
from bs4 import BeautifulSoup
url = "http://www.espncricinfo.com/"
web_page = urllib2.urlopen(url)
soup = BeautifulSoup(web_page , 'html.parser')
print (soup.prettify().encode('utf-8'))
尝试将html文档而不是url传递到以下地址：
import urllib2
from bs4 import BeautifulSoup
url = "http://www.espncricinfo.com/"
web_page = urllib2.urlopen(url)
soup = BeautifulSoup(web_page , 'html.parser')
print (soup.prettify().encode('utf-8'))
urlib2.urlopen（url）web\u页面中url由
urllib2.urlopen（url）web\u页面中