Can';t使用python URL库解析Google标题
我无法分析Google搜索结果:Can';t使用python URL库解析Google标题,python,python-3.x,urllib,Python,Python 3.x,Urllib,我无法分析Google搜索结果: def extracter(url,key,change): if " " in key: key=key.replace(" ",str(change)) url=url+str(key) response=ur.Request(url, headers={'User-Agent': 'Mozilla/5.0'}) sauce =ur.urlopen(response).read() soup=bs(sa
def extracter(url,key,change):
if " " in key:
key=key.replace(" ",str(change))
url=url+str(key)
response=ur.Request(url, headers={'User-Agent': 'Mozilla/5.0'})
sauce =ur.urlopen(response).read()
soup=bs(sauce,"html.parser")
return soup
def google(keyword):
soup = extracter("https://www.google.com/search?q=",str(keyword),"+")
search_result = soup.findAll("h3",attrs={"class":"LC20lb"})
print(search_result)
google("tony stark")
输出:
[]
我只是简单地更改了标题,效果很好:
headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.71 Safari/537.36'}
结果:
[<h3 class="LC20lb"><span dir="ltr">Tony Stark (Marvel Cinematic Universe) - Wikipedia</span></h3>, <h3 class="LC20lb"><span dir="ltr">Tony Stark / Iron Man - Wikipedia</span></h3>, <h3 class="LC20lb"><span dir="ltr">Iron Man | Marvel Cinematic Universe Wiki | FANDOM ...</span></h3>, <h3 class="LC20lb"><span dir="ltr">Tony Stark (Earth-199999) | Iron Man Wiki | FANDOM ...</span></h3>, <h3 class="LC20lb"><span dir="ltr">Is Tony Stark Alive As AI? Marvel Fans Say Tony Stark ...</span></h3>, <h3 class="LC20lb"><span dir="ltr">'Avengers: Endgame' Might Not Have Been the End of Tony ...</span></h3>, <h3 class="LC20lb"><span dir="ltr">Robert Downey Jr to RETURN to MCU as AI Tony Stark - ...</span></h3>, <h3 class="LC20lb"><span dir="ltr">Avengers Endgame theory: Tony Stark is backed up as AI ...</span></h3>]
[托尼·斯塔克(惊奇漫画电影世界)-维基百科,托尼·斯塔克/钢铁侠-维基百科,钢铁侠|惊奇漫画电影世界维基|粉丝…,托尼·斯塔克(地球-199999)|铁人维基|粉丝群…,托尼·斯塔克还活着吗?惊奇漫画粉丝说托尼·斯塔克…,《复仇者:终局》可能不是托尼的结局…,小罗伯特·唐尼回到MCU扮演AI托尼·斯塔克-…,复仇者终局论:托尼·斯塔克被支持为AI…]
我只是简单地更改了标题,效果很好:
headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.71 Safari/537.36'}
结果:
[<h3 class="LC20lb"><span dir="ltr">Tony Stark (Marvel Cinematic Universe) - Wikipedia</span></h3>, <h3 class="LC20lb"><span dir="ltr">Tony Stark / Iron Man - Wikipedia</span></h3>, <h3 class="LC20lb"><span dir="ltr">Iron Man | Marvel Cinematic Universe Wiki | FANDOM ...</span></h3>, <h3 class="LC20lb"><span dir="ltr">Tony Stark (Earth-199999) | Iron Man Wiki | FANDOM ...</span></h3>, <h3 class="LC20lb"><span dir="ltr">Is Tony Stark Alive As AI? Marvel Fans Say Tony Stark ...</span></h3>, <h3 class="LC20lb"><span dir="ltr">'Avengers: Endgame' Might Not Have Been the End of Tony ...</span></h3>, <h3 class="LC20lb"><span dir="ltr">Robert Downey Jr to RETURN to MCU as AI Tony Stark - ...</span></h3>, <h3 class="LC20lb"><span dir="ltr">Avengers Endgame theory: Tony Stark is backed up as AI ...</span></h3>]
[托尼·斯塔克(惊奇漫画电影世界)-维基百科,托尼·斯塔克/钢铁侠-维基百科,钢铁侠|惊奇漫画电影世界维基|粉丝…,托尼·斯塔克(地球-199999)|铁人维基|粉丝群…,托尼·斯塔克还活着吗?惊奇漫画粉丝说托尼·斯塔克…,《复仇者:终局》可能不是托尼的结局…,小罗伯特·唐尼回到MCU扮演AI托尼·斯塔克-…,复仇者终局论:托尼·斯塔克被支持为AI…]