使用python ps4从网页中删除所有表

使用python ps4从网页中删除所有表,python,web-scraping,beautifulsoup,datatables,Python,Web Scraping,Beautifulsoup,Datatables,我想使用beautifulsoup获取此链接中的所有表https://www.investing.com/indices/indices-futures,接下来我想获取索引列中的标题以及这些标题的链接 我只想要第一栏的内容 比如说 title href Dow Jones /indices/us-30-futures S&P 500 /indices/us-spx-500-futures ... Mini DAX /indices/mini-dax-

我想使用beautifulsoup获取此链接中的所有表
https://www.investing.com/indices/indices-futures
,接下来我想获取索引列中的标题以及这些标题的链接

我只想要第一栏的内容

比如说

title        href
Dow Jones    /indices/us-30-futures
S&P 500      /indices/us-spx-500-futures
...
Mini DAX     /indices/mini-dax-futures
...
VSTOXX Mini  /indices/vstoxx-mini 


我使用以下代码

url = "https://www.investing.com/indices/indices-futures"
req = requests.get(url, headers=urlheader)
soup = BeautifulSoup(req.content, "lxml")
table = soup.find('div', id="cross_rates_container")
for a in table.find_all('a', href=True):
    print (a['title'], a['href'])
我可以看到table变量,但似乎无法访问title(包含索引名)和href(包含链接)


有什么问题吗?如何一次获取所有表的条目

您可以迭代
元素并获得

这部分的意思
('td.plusIconTd>a'):
?@anarchy
汤。选择('td.plusIconTd>a')
选择
标记下带有
class=plusIconTd
的所有
元素<代码>'td.plusIconTd>a'
这是CSS选择器。<代码>{:你是怎么找到plusIconTd的?我看到的只是这个,我似乎找不到plusIconTd的一部分。谢谢你,我看到了,但是你怎么知道当名字是<代码>粗体左plusIconTd noWrap elp时只使用
plusIconTd
import requests
from bs4 import BeautifulSoup


url = 'https://www.investing.com/indices/indices-futures'
headers = {'User-Agent': 'Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:76.0) Gecko/20100101 Firefox/76.0'}
soup = BeautifulSoup(requests.get(url, headers=headers).content, 'html.parser')

print('{:<30} {}'.format('Title', 'URL'))
for a in soup.select('td.plusIconTd > a'):
    print('{:<30} {}'.format(a.text, 'https://www.investing.com' + a['href']))
Title                          URL
Dow Jones                      https://www.investing.com/indices/us-30-futures
S&P 500                        https://www.investing.com/indices/us-spx-500-futures
Nasdaq                         https://www.investing.com/indices/nq-100-futures
SmallCap 2000                  https://www.investing.com/indices/smallcap-2000-futures
S&P 500 VIX                    https://www.investing.com/indices/us-spx-vix-futures
DAX                            https://www.investing.com/indices/germany-30-futures
CAC 40                         https://www.investing.com/indices/france-40-futures
FTSE 100                       https://www.investing.com/indices/uk-100-futures
Euro Stoxx 50                  https://www.investing.com/indices/eu-stocks-50-futures
FTSE MIB                       https://www.investing.com/indices/italy-40-futures
SMI                            https://www.investing.com/indices/switzerland-20-futures
IBEX 35                        https://www.investing.com/indices/spain-35-futures
ATX                            https://www.investing.com/indices/austria-20-futures
WIG20                          https://www.investing.com/indices/poland-20-futures
AEX                            https://www.investing.com/indices/netherlands-25-futures
BUX                            https://www.investing.com/indices/hungary-14-futures
RTS                            https://www.investing.com/indices/rts-cash-settled-futures

... and so on.