[已解决]爬虫问题求助

sgsdg

爬取某网站的图片，错误信息如下，求大佬帮忙分析一下

1. Traceback (most recent call last):
   
2.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\urllib3\contrib\pyopenssl.py", line 453, in wrap_socket
   
3.     cnx.do_handshake()
   
4.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\OpenSSL\SSL.py", line 1907, in do_handshake
   
5.     self._raise_ssl_error(self._ssl, result)
   
6.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\OpenSSL\SSL.py", line 1632, in _raise_ssl_error
   
7.     raise SysCallError(-1, "Unexpected EOF")
   
8. OpenSSL.SSL.SysCallError: (-1, 'Unexpected EOF')
   
9. 
   
10. During handling of the above exception, another exception occurred:
    
11. 
    
12. Traceback (most recent call last):
    
13.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\urllib3\connectionpool.py", line 600, in urlopen
    
14.     chunked=chunked)
    
15.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\urllib3\connectionpool.py", line 343, in _make_request
    
16.     self._validate_conn(conn)
    
17.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\urllib3\connectionpool.py", line 839, in _validate_conn
    
18.     conn.connect()
    
19.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\urllib3\connection.py", line 344, in connect
    
20.     ssl_context=context)
    
21.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\urllib3\util\ssl_.py", line 344, in ssl_wrap_socket
    
22.     return context.wrap_socket(sock, server_hostname=server_hostname)
    
23.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\urllib3\contrib\pyopenssl.py", line 459, in wrap_socket
    
24.     raise ssl.SSLError('bad handshake: %r' % e)
    
25. ssl.SSLError: ("bad handshake: SysCallError(-1, 'Unexpected EOF')",)
    
26. 
    
27. During handling of the above exception, another exception occurred:
    
28. 
    
29. Traceback (most recent call last):
    
30.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\requests\adapters.py", line 449, in send
    
31.     timeout=timeout
    
32.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\urllib3\connectionpool.py", line 638, in urlopen
    
33.     _stacktrace=sys.exc_info()[2])
    
34.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\urllib3\util\retry.py", line 398, in increment
    
35.     raise MaxRetryError(_pool, url, error or ResponseError(cause))
    
36. urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='data.whicdn.com', port=443): Max retries exceeded with url: /images/322761355/superthumb.jpg?t=1542973062 (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),))
    
37. 
    
38. During handling of the above exception, another exception occurred:
    
39. 
    
40. Traceback (most recent call last):
    
41.   File "C:/Users/47689/Desktop/爬虫/Taylor.py", line 75, in <module>
    
42.     main()
    
43.   File "C:/Users/47689/Desktop/爬虫/Taylor.py", line 72, in main
    
44.     save_imgs(img_urls, page)
    
45.   File "C:/Users/47689/Desktop/爬虫/Taylor.py", line 48, in save_imgs
    
46.     img = url_open(each_url,headers)
    
47.   File "C:/Users/47689/Desktop/爬虫/Taylor.py", line 25, in url_open
    
48.     web_data = requests.get(url,headers=headers,proxies=proxies)
    
49.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\requests\api.py", line 75, in get
    
50.     return request('get', url, params=params, **kwargs)
    
51.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\requests\api.py", line 60, in request
    
52.     return session.request(method=method, url=url, **kwargs)
    
53.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\requests\sessions.py", line 533, in request
    
54.     resp = self.send(prep, **send_kwargs)
    
55.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\requests\sessions.py", line 646, in send
    
56.     r = adapter.send(request, **kwargs)
    
57.   File "C:\Users\47689\Documents\spider\venv\lib\site-packages\requests\adapters.py", line 514, in send
    
58.     raise SSLError(e, request=request)
    
59. requests.exceptions.SSLError: HTTPSConnectionPool(host='data.whicdn.com', port=443): Max retries exceeded with url: /images/322761355/superthumb.jpg?t=1542973062 (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')",),))

复制代码

最佳答案

月排行榜 / 总排行榜

wongyusing

2018-12-9 21:00:31

看报错，应该是你的证书有问题。  
地址应该是https开头的对吧？？
想办法加上证书
不行的话，换其他方式或框架进行爬取

跳转到最佳答案楼层

fan1993423

你上代码和你想爬取的网站吧

wongyusing

看报错，应该是你的证书有问题。  
地址应该是https开头的对吧？？
想办法加上证书
不行的话，换其他方式或框架进行爬取

sgsdg

wongyusing 发表于 2018-12-9 21:00
看报错，应该是你的证书有问题。  
地址应该是https开头的对吧？？
想办法加上证书

https://weheartit.com/inspirations/taylorswift?
这个网站，不知道怎么加证书，我把verify设成False可以爬取一部分图片。

wongyusing

sgsdg 发表于 2018-12-10 09:46
https://weheartit.com/inspirations/taylorswift?
这个网站，不知道怎么加证书，我把verify设成False可 ...

还有一种方法是，尝试把https的s去掉