[已解决]Python爬虫，运行一下报错一大片

苏绛雪

我的python爬虫报错，

1. mport requests
   
2. import re
   
3. 
   
4. 
   
5. Headers = {
   
6.     'user-agent': "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36"}
   
7. response=requests.get("https://www.vmgirls.com/9384.html",headers=Headers)
   
8. #print(response.request.headers)
   
9. html=response.text
   
10. 
    
11. #print(html)
    
12. print("------------------------------------------------------------------------------------------------")
    
13. s=re.findall('<img alt=".*?" src="(.*?)" >',html)
    
14. print(s)

复制代码

图片如下：

最佳答案

月排行榜 / 总排行榜

冬雪雪冬

2020-2-14 22:08:33

1.我运行了你的程序，没有出错，但也没有输出，建议重装requests库。
2.用re不如用bs4方便。我用bs4修改了你的程序，供参考。

1. import requests
   
2. import bs4
   
3. 
   
4. 
   
5. Headers = {
   
6.     'user-agent': "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36"}
   
7. response=requests.get("https://www.vmgirls.com/9384.html",headers=Headers)
   
8. #print(response.request.headers)
   
9. html=response.text
   
10. 
    
11. soup = bs4.BeautifulSoup(html, "html.parser")
    
12. result = soup.find_all("img", class_="alignnone size-full")
    
13. for each in result:
    
14.         print(each["data-src"])

复制代码

1. https://static.vmgirls.com/image/2018/08/2018-08-10_13-52-47.jpg
   
2. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-00.jpg
   
3. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-05.jpg
   
4. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-10.jpg
   
5. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-20.jpg
   
6. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-26.jpg
   
7. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-32.jpg

复制代码

跳转到最佳答案楼层

冬雪雪冬

1.我运行了你的程序，没有出错，但也没有输出，建议重装requests库。
2.用re不如用bs4方便。我用bs4修改了你的程序，供参考。

1. import requests
   
2. import bs4
   
3. 
   
4. 
   
5. Headers = {
   
6.     'user-agent': "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36"}
   
7. response=requests.get("https://www.vmgirls.com/9384.html",headers=Headers)
   
8. #print(response.request.headers)
   
9. html=response.text
   
10. 
    
11. soup = bs4.BeautifulSoup(html, "html.parser")
    
12. result = soup.find_all("img", class_="alignnone size-full")
    
13. for each in result:
    
14.         print(each["data-src"])

复制代码

1. https://static.vmgirls.com/image/2018/08/2018-08-10_13-52-47.jpg
   
2. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-00.jpg
   
3. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-05.jpg
   
4. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-10.jpg
   
5. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-20.jpg
   
6. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-26.jpg
   
7. https://static.vmgirls.com/image/2018/08/2018-08-10_13-53-32.jpg

复制代码

沉好人

程序没出错，但没输出，改了一下

1. 
   
2. import requests
   
3. import re
   
4. 
   
5. 
   
6. Headers = {
   
7.     'user-agent': "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36"
   
8.     }
   
9. response=requests.get("https://www.vmgirls.com/9384.html",headers=Headers)
   
10. #print(response.request.headers)
    
11. html=response.text
    
12. 
    
13. print("------------------------------------------------------------------------------------------------")
    
14. s=re.findall('size-full" data-src="(https:[^"]+\.jpg)',html)
    
15. for each in s:
    
16.     print(each)
    
17. 
    

复制代码

米多花

报的错是说请求超时，即这个网站无法访问，有几种原因：这个网站被墙了，你访问不了；或者你的网络有问题。

我换了一个网站，访问正常。另外你的正则表达式写得不严谨，我帮你改了一下。运行之前请你确认安装了requests模块

1. import requests
   
2. import re
   
3. 
   
4. 
   
5. Headers = {
   
6.     'user-agent': "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36"}
   
7. response = requests.get(
   
8.     "https://www.meitulu.com/item/3289.html", headers=Headers)
   
9. # print(response.request.headers)
   
10. html = response.text
    
11. 
    
12. # print(html)
    
13. print("------------------------------------------------------------------------------------------------")
    
14. s = re.findall('<img[^>]*?src=[\'"]([^\'"]*?jpg)[\'"][^>]*?>',
    
15.                html, flags=re.I | re.M | re.S)
    
16. print(s)

复制代码

结果：

1. [
   
2. 'https://mtl.gzhuibei.com/css/logo.jpg',
   
3. 'https://mtl.gzhuibei.com/images/img/3289/1.jpg',
   
4. 'https://mtl.gzhuibei.com/images/img/3289/2.jpg',
   
5. 'https://mtl.gzhuibei.com/images/img/3289/3.jpg',
   
6. 'https://mtl.gzhuibei.com/images/img/3289/4.jpg',
   
7. 'https://mtl.gzhuibei.com/images/img/10695/0.jpg',
   
8. 'https://mtl.gzhuibei.com/images/img/16676/0.jpg',
   
9. 'https://mtl.gzhuibei.com/images/img/16029/0.jpg',
   
10. 'https://mtl.gzhuibei.com/images/img/16512/0.jpg',
    
11. 'https://mtl.gzhuibei.com/images/img/6809/0.jpg',
    
12. 'https://mtl.gzhuibei.com/images/img/17765/0.jpg',
    
13. 'https://mtl.gzhuibei.com/images/img/17831/0.jpg',
    
14. 'https://mtl.gzhuibei.com/images/img/17733/0.jpg'
    
15. ]

复制代码