[已解决]爬取网页源码与审查元素不一致如何解决？（cookies已加）

叙白

这样

1. import requests
   
2. from lxml import etree
   
3. url = 'https://music.163.com/discover/toplist'
   
4. headers = {
   
5.     'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.149 Safari/537.36'
   
6. }
   
7. response = requests.get(url,headers = headers)
   
8. text = response.text
   
9. 
   
10. html = etree.HTML(text)
    
11. songname = html.xpath('//ul[@class="f-hide"]//a/text()')
    
12. address = html.xpath('//ul[@class="f-hide"]//a/@href')
    
13. print(songname)
    
14. print(address)

复制代码