爬虫问题

pyrhon萌新#

百度贴吧如何用re爬取楼主及回复的用户？
帮帮我吧，谢谢大佬们了

Twilight6

来个具体链接~

liuzhengyuan

1. <div id="post_content_\d+?" class="d_post_content j_d_post_content " style="display:;">(.+?)</div>

复制代码

这样正则试试？

pyrhon萌新#

Twilight6 发表于 2020-7-7 20:47
来个具体链接~

https://tieba.baidu.com/p/6503175911

Twilight6

pyrhon萌新# 发表于 2020-7-8 16:24
https://tieba.baidu.com/p/6503175911

抱歉，之前没看到评论，这样可以吧？

1. import requests
   
2. import re
   
3. 
   
4. 
   
5. url = 'https://tieba.baidu.com/p/6503175911'
   
6. headers = {
   
7.     'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36'
   
8. }
   
9. 
   
10. request = requests.get(url,headers=headers)
    
11. html = request.text
    
12. contents = re.findall(r'.+style="display:;">(.+?)</div>',html)
    
13. for i in range(len(contents)):
    
14.     contents[i] = contents[i].strip()
    
15. print(contents)

复制代码