[已解决]爬虫xpath解析问题求助

代码小白liu

1. import requests
   
2. from lxml import etree
   
3. url = "https://sc.chinaz.com/ppt/free.html"
   
4. headers= {
   
5.     "User-Agent": "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.114 Mobile Safari/537.36"
   
6. }
   
7. response = requests.get(url,headers=headers)
   
8. response.encoding = "utf-8"
   
9. html_text = response.text
   
10. tree = etree.HTML(html_text)
    
11. #获取模板名称name和下载地址
    
12. div_list = tree.xpath('//div[@class="ppt-list  masonry"]/div')
    
13. for div in div_list:
    
14.     download_url ="https://sc.chinaz.com/ppt/"+ div.xpath('./div[2]/a/@href')[0]
    
15.     name= div.xpath('./div[2]/a/@title')[0]
    
16.     print(download_url, name)
    

复制代码

为什么打印出来没数据那？提示：Process finished with exit code 0

最佳答案

月排行榜 / 总排行榜

路神

2021-7-15 22:42:41

1. import requests
   
2. from lxml import etree
   
3. 
   
4. url = "https://sc.chinaz.com/ppt/free.html"
   
5. headers = {
   
6.     "User-Agent": "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.114 Mobile Safari/537.36"
   
7. }
   
8. response = requests.get(url, headers=headers)
   
9. response.encoding = "utf-8"
   
10. html_text = response.text
    
11. tree = etree.HTML(html_text)
    
12. # 获取模板名称name和下载地址
    
13. div_list = tree.xpath('//div[@class="ppt-list "]/div')
    
14. for div in div_list:
    
15.     download_url = "https://sc.chinaz.com/ppt/" + div.xpath('./div[2]/a/@href')[0]
    
16.     name = div.xpath('./div[2]/a/@title')[0]
    
17.     print(download_url, name)
    

复制代码

跳转到最佳答案楼层

路神

1. import requests
   
2. from lxml import etree
   
3. 
   
4. url = "https://sc.chinaz.com/ppt/free.html"
   
5. headers = {
   
6.     "User-Agent": "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.114 Mobile Safari/537.36"
   
7. }
   
8. response = requests.get(url, headers=headers)
   
9. response.encoding = "utf-8"
   
10. html_text = response.text
    
11. tree = etree.HTML(html_text)
    
12. # 获取模板名称name和下载地址
    
13. div_list = tree.xpath('//div[@class="ppt-list "]/div')
    
14. for div in div_list:
    
15.     download_url = "https://sc.chinaz.com/ppt/" + div.xpath('./div[2]/a/@href')[0]
    
16.     name = div.xpath('./div[2]/a/@title')[0]
    
17.     print(download_url, name)
    

复制代码

冷小漠

requests爬下来的HTML源代码你仔细看一下，对应的div的class名称是没有后面一段的，调整一下xpath即可。

代码小白liu

冷小漠 发表于 2021-7-16 00:28
requests爬下来的HTML源代码你仔细看一下，对应的div的class名称是没有后面一段的，调整一下xpath即可。

看到了 谢谢

Kayko