爬虫

君子好逑

1. import requests
   
2. from lxml import etree
   
3. 
   
4. url = 'http://www.xbiquge.la/modules/article/waps.php'
   
5. 
   
6. 
   
7. 
   
8. data = {
   
9.     'searchkey':'无敌真寂寞'
   
10. }
    
11. 
    
12. headers = {
    
13.     'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36 Edge/18.18363'
    
14. }
    
15. 
    
16. reponse = requests.post(url=url,headers=headers,data=data)
    
17. reponse.encoding = reponse.apparent_encoding
    
18. html = reponse.text
    
19. # print(html)
    
20. tree = etree.HTML(html)
    
21. 
    
22. content = tree.xpath('//table[@class="grid"]/tbody//text()')
    
23. 
    
24. print(content)
    

复制代码

我爬这个网页的时候xpath里不加tbody信息都能打印出来，一加tbody就什么都没了，有大佬能给看一下吗