Python 爬取B站视频链接&标题

qiuyouzhi

Python 爬取B站视频链接&标题

先放源码：

1. from requests import get
   
2. from lxml import etree
   
3. 
   
4. def open_url(url):
   
5.     headers = {
   
6.         'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.122 Safari/537.36'
   
7.         }
   
8.     res = get(url, headers = headers)
   
9.     return res
   
10. 
    
11. def get_Video(res):
    
12.     html = etree.HTML(res.text)
    
13.     name = html.xpath('//*[@class="video-item matrix"]/a/@title')
    
14.     href = html.xpath('//*[@class="video-item matrix"]/a/@href')
    
15.     for i in range(len(href)):
    
16.         href[i]='https:' + href[i]
    
17.     return name, href
    
18.    
    
19. 
    
20. def main():
    
21.     keyw = input("请输入关键字：")
    
22.     url = 'https://search.bilibili.com/all?keyword=%s&from_source=nav_search&spm_id_from=333.851.b_696e7465726e6174696f6e616c486561646572.15' % keyw
    
23.     res = open_url(url)
    
24.     name, href = get_Video(res)
    
25.     temp = {} # 这个temp用于改进，可以删掉
    
26.     for i in range(len(name)):
    
27.         print(name[i], ':', href[i])
    
28.         temp[i+1] = name[i], href[i]
    
29. 
    
30. if __name__ == "__main__":
    
31.     main()

复制代码

用bs4可谓极其简单，但是我想练练XPath

感觉XPath好简单，把路径关系写进去就好了。

MIke_python小小

沙发有奖励吗

MIke_python小小

沙发有奖励吗

顶一下

帖都沉了