python爬虫遇到问题，大神请进

李易峰

1. import requests
   
2. from bs4 import BeautifulSoup
   
3. 
   
4. 
   
5. headers = {'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Safari/537.36'}
   
6. r = requests.get('http://www.qiushibaike.com', headers = headers)
   
7. content = r.text
   
8. soup = BeautifulSoup(r.text, 'lxml')
   
9. 
   
10. divs = soup.find_all(class_ = 'article block untagged mb15')
    
11. print(divs)
    

复制代码

这个错误是输出[]空列表

luckin

你看你截图的蓝色选中的部分后面还有内容
改成divs = soup.find_all(class_ = 'article block untagged mb15 typs_recent')

零度非安全

你这样是匹配不到的，因为这个属性有多个值，解决办法用 xpath 最容易，如下：

1. import requests
   
2. from lxml import etree
   
3. 
   
4. 
   
5. headers = {'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.2924.87 Safari/537.36'}
   
6. r = requests.get('http://www.qiushibaike.com', headers = headers)
   
7. content = r.text
   
8. soup = etree.HTML(content)
   
9. divs = soup.xpath('//div[contains(@class, "article")]')
   
10. print(divs)
    

复制代码