[已解决]爬虫xpath解析问题求助

代码小白liu · 发表于 2021-7-15 22:09:13

马上注册，结交更多好友，享用更多功能^_^

您需要登录才可以下载或查看，没有账号？立即注册

x

import requests
from lxml import etree
url = "https://sc.chinaz.com/ppt/free.html"
headers= {
    "User-Agent": "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.114 Mobile Safari/537.36"
}
response = requests.get(url,headers=headers)
response.encoding = "utf-8"
html_text = response.text
tree = etree.HTML(html_text)
#获取模板名称name和下载地址
div_list = tree.xpath('//div[@class="ppt-list  masonry"]/div')
for div in div_list:
    download_url ="https://sc.chinaz.com/ppt/"+ div.xpath('./div[2]/a/@href')[0]
    name= div.xpath('./div[2]/a/@title')[0]
    print(download_url, name)

为什么打印出来没数据那？提示：Process finished with exit code 0

最佳答案

月排行榜 / 总排行榜

路神

2021-7-15 22:42:41

import requests
from lxml import etree

url = "https://sc.chinaz.com/ppt/free.html"
headers = {
    "User-Agent": "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.114 Mobile Safari/537.36"
}
response = requests.get(url, headers=headers)
response.encoding = "utf-8"
html_text = response.text
tree = etree.HTML(html_text)
# 获取模板名称name和下载地址
div_list = tree.xpath('//div[@class="ppt-list "]/div')
for div in div_list:
    download_url = "https://sc.chinaz.com/ppt/" + div.xpath('./div[2]/a/@href')[0]
    name = div.xpath('./div[2]/a/@title')[0]
    print(download_url, name)

跳转到最佳答案楼层

路神 · 发表于 2021-7-15 22:42:41

import requests
from lxml import etree

url = "https://sc.chinaz.com/ppt/free.html"
headers = {
    "User-Agent": "Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.114 Mobile Safari/537.36"
}
response = requests.get(url, headers=headers)
response.encoding = "utf-8"
html_text = response.text
tree = etree.HTML(html_text)
# 获取模板名称name和下载地址
div_list = tree.xpath('//div[@class="ppt-list "]/div')
for div in div_list:
    download_url = "https://sc.chinaz.com/ppt/" + div.xpath('./div[2]/a/@href')[0]
    name = div.xpath('./div[2]/a/@title')[0]
    print(download_url, name)

冷小漠 · 发表于 2021-7-16 00:28:56

requests爬下来的HTML源代码你仔细看一下，对应的div的class名称是没有后面一段的，调整一下xpath即可。

代码小白liu · 发表于 2021-7-16 19:47:59

冷小漠发表于 2021-7-16 00:28
requests爬下来的HTML源代码你仔细看一下，对应的div的class名称是没有后面一段的，调整一下xpath即可。

看到了谢谢

Kayko · 发表于 2021-7-17 07:00:14

账号		自动登录	找回密码
密码			立即注册