[已解决]求解如何爬这个中国气象局api的数据

CHNwldcmzy

在网上的博客里找了几个api但都已经不更新了

我找到一个链接，这个链接浏览器能正常访问，但我用爬虫爬不下来
http://t.weather.sojson.com/api/weather/city/101010100


代码和报错如下

1. 
   
2. import requests
   
3. header = {
   
4.     'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9',
   
5.     'Accept-Encoding': 'gzip, deflate',
   
6.     'Accept-Language': 'zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US;q=0.6',
   
7.     'Cache-Control': 'max-age=0',
   
8.     'Host': 't.weather.sojson.com',
   
9.     'Proxy-Connection': 'keep-alive',
   
10.     'Upgrade-Insecure-Requests': '1',
    
11.     'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36 Edg/108.0.1462.54',
    
12. }
    
13. 
    
14. res = requests.get('http://t.weather.sojson.com/api/weather/city/101010100', headers=header)
    

复制代码

1. Traceback (most recent call last):
   
2.   File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connection.py", line 174, in _new_conn
   
3.     conn = connection.create_connection(
   
4.   File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\util\connection.py", line 72, in create_connection
   
5.     for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
   
6.   File "C:\ProgramData\Anaconda3\lib\socket.py", line 954, in getaddrinfo
   
7.     for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
   
8. socket.gaierror: [Errno 11001] getaddrinfo failed
   
9. 
   
10. During handling of the above exception, another exception occurred:
    
11. 
    
12. Traceback (most recent call last):
    
13.   File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connectionpool.py", line 703, in urlopen
    
14.     httplib_response = self._make_request(
    
15.   File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connectionpool.py", line 398, in _make_request
    
16.     conn.request(method, url, **httplib_request_kw)
    
17.   File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connection.py", line 239, in request
    
18.     super(HTTPConnection, self).request(method, url, body=body, headers=headers)
    
19.   File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1285, in request
    
20.     self._send_request(method, url, body, headers, encode_chunked)
    
21.   File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1331, in _send_request
    
22.     self.endheaders(body, encode_chunked=encode_chunked)
    
23.   File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1280, in endheaders
    
24.     self._send_output(message_body, encode_chunked=encode_chunked)
    
25.   File "C:\ProgramData\Anaconda3\lib\http\client.py", line 1040, in _send_output
    
26.     self.send(msg)
    
27.   File "C:\ProgramData\Anaconda3\lib\http\client.py", line 980, in send
    
28.     self.connect()
    
29.   File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connection.py", line 205, in connect
    
30.     conn = self._new_conn()
    
31.   File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connection.py", line 186, in _new_conn
    
32.     raise NewConnectionError(
    
33. urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x0000021C5AD86D60>: Failed to establish a new connection: [Errno 11001] getaddrinfo failed
    
34. 
    
35. During handling of the above exception, another exception occurred:
    
36. 
    
37. Traceback (most recent call last):
    
38.   File "C:\ProgramData\Anaconda3\lib\site-packages\requests\adapters.py", line 440, in send
    
39.     resp = conn.urlopen(
    
40.   File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\connectionpool.py", line 785, in urlopen
    
41.     retries = retries.increment(
    
42.   File "C:\ProgramData\Anaconda3\lib\site-packages\urllib3\util\retry.py", line 592, in increment
    
43.     raise MaxRetryError(_pool, url, error or ResponseError(cause))
    
44. urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='t.weather.sojson.com', port=80): Max retries exceeded with url: /api/weather/city/101010100 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x0000021C5AD86D60>: Failed to establish a new connection: [Errno 11001] getaddrinfo failed'))
    
45. 
    
46. During handling of the above exception, another exception occurred:
    
47. 
    
48. Traceback (most recent call last):
    
49.   File "c:\Users\wldcmzy\Desktop\asdf.txt.py", line 14, in <module>
    
50.     res = requests.get('http://t.weather.sojson.com/api/weather/city/101010100', headers=header)
    
51.   File "C:\ProgramData\Anaconda3\lib\site-packages\requests\api.py", line 75, in get
    
52.     return request('get', url, params=params, **kwargs)
    
53.   File "C:\ProgramData\Anaconda3\lib\site-packages\requests\api.py", line 61, in request
    
54.     return session.request(method=method, url=url, **kwargs)
    
55.   File "C:\ProgramData\Anaconda3\lib\site-packages\requests\sessions.py", line 529, in request
    
56.     resp = self.send(prep, **send_kwargs)
    
57.   File "C:\ProgramData\Anaconda3\lib\site-packages\requests\sessions.py", line 645, in send
    
58.     r = adapter.send(request, **kwargs)
    
59.   File "C:\ProgramData\Anaconda3\lib\site-packages\requests\adapters.py", line 519, in send
    
60.     raise ConnectionError(e, request=request)
    
61. requests.exceptions.ConnectionError: HTTPConnectionPool(host='t.weather.sojson.com', port=80): Max retries exceeded with url: /api/weather/city/101010100 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x0000021C5AD86D60>: Failed to establish a new connection: [Errno 11001] getaddrinfo failed'))

复制代码

最佳答案

月排行榜 / 总排行榜

isdkz

2022-12-24 19:24:32

你这是网络问题吧，你在浏览器能打开这个链接吗？

跳转到最佳答案楼层

gywjj

我试了一下，可以爬啊，直接用的你的代码

CHNwldcmzy

gywjj 发表于 2022-12-24 17:52
我试了一下，可以爬啊，直接用的你的代码

阿哲  那给我整的更不会了0.0

chinajz

在python 3.11.1中运行没有任何错误

isdkz

你这是网络问题吧，你在浏览器能打开这个链接吗？

CHNwldcmzy

isdkz 发表于 2022-12-24 19:24
你这是网络问题吧，你在浏览器能打开这个链接吗？

浏览器正常访问 没有问题呀

CHNwldcmzy

isdkz 发表于 2022-12-24 19:24
你这是网络问题吧，你在浏览器能打开这个链接吗？

我知道了，以前蹭学校没法自动获取ip的网线改了dns忘了改回自动，本来浏览器应该什么也不能访问了，但是挂了代理把这个问题掩盖了，导致我以为网络没问题，现在好了0.0