[已解决]031-永久存储-课件中天气查询

亚瑟与精灵

按照小甲鱼的步骤将城市数据保存为pkl文件，之后运行主程序，报错：

天气查询出错

403应该是访问被拒，是不是因为这个爬虫代码太久之前的，所以无论访问哪一个网站几乎都会被拒绝（除过百度）？

最佳答案

月排行榜 / 总排行榜

kaohsing

2019-12-4 11:50:24

1. import urllib.request
   
2. import pickle
   
3. import time
   
4. import json
   
5. pickle_file = open('city_data.pkl', 'rb')
   
6. city = pickle.load(pickle_file)
   
7. 
   
8. password = input('请输入城市:')
   
9. cityid = city[password]
   
10. 
    
11. url = r'http://d1.weather.com.cn/weather_index/{}.html?_={}'.format(cityid, str(int(time.time() * 1000)))
    
12. headers = {
    
13.     'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3947.100 Safari/537.36',
    
14.     'Referer': 'http://www.weather.com.cn/weather1d/{}.shtml'.format(cityid)
    
15. }
    
16. request = urllib.request.Request(url=url, headers=headers)
    
17. res = urllib.request.urlopen(request)
    
18. js = res.read().decode('utf-8')
    
19. print(js)
    
20. #分析数据自己写吧

复制代码

跳转到最佳答案楼层

wp231957

拿代码说话

zltzlt

代码呢？

亚瑟与精灵

1. 
   
2. import urllib.request
   
3. import json
   
4. import pickle
   
5. 
   
6. pickle_file = open('D:\日志\code\city_data.pkl','rb')
   
7. city = pickle.load(pickle_file)
   
8. password=input('请输入城市:')
   
9. name1=city[password]
   
10. File1 =urllib.request.urlopen('http://m.weather.com.cn/data/'+name1+'.html')#打开url
    
11. weatherHTML= File1.read().decode('utf-8')#读入打开的url
    
12. weatherJSON = json.JSONDecoder().decode(weatherHTML)#创建json
    
13. weatherInfo = weatherJSON['weatherinfo']
    
14. #打印信息
    
15. print ( '城市：', weatherInfo['city'])
    
16. print ('时间：', weatherInfo['date_y'])
    
17. print ( '24小时天气：')
    
18. print ('温度：', weatherInfo['temp1'])
    
19. print ('天气：', weatherInfo['weather1'])
    
20. print ('风速：', weatherInfo['wind1'])
    
21. print ('紫外线：', weatherInfo['index_uv'])
    
22. print ('穿衣指数：', weatherInfo['index_d'])
    
23. print ('48小时天气：')
    
24. print ('温度：', weatherInfo['temp2'])
    
25. print ('天气：', weatherInfo['weather2'])
    
26. print ('风速：', weatherInfo['wind2'])
    
27. print ('紫外线：', weatherInfo['index48_uv'])
    
28. print ('穿衣指数：', weatherInfo['index48_d'])
    
29. print ('72小时天气：')
    
30. print ('温度：', weatherInfo['temp3'])
    
31. print ('天气：', weatherInfo['weather3'])
    
32. print ('风速：', weatherInfo['wind3'])
    
33. input ('按任意键退出：')

复制代码

亚瑟与精灵

zltzlt 发表于 2019-12-3 20:16
代码呢？

代码已经贴出来了

kaohsing

网址变了，还加了防爬措施

kaohsing

1. import urllib.request
   
2. import pickle
   
3. import time
   
4. import json
   
5. pickle_file = open('city_data.pkl', 'rb')
   
6. city = pickle.load(pickle_file)
   
7. 
   
8. password = input('请输入城市:')
   
9. cityid = city[password]
   
10. 
    
11. url = r'http://d1.weather.com.cn/weather_index/{}.html?_={}'.format(cityid, str(int(time.time() * 1000)))
    
12. headers = {
    
13.     'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3947.100 Safari/537.36',
    
14.     'Referer': 'http://www.weather.com.cn/weather1d/{}.shtml'.format(cityid)
    
15. }
    
16. request = urllib.request.Request(url=url, headers=headers)
    
17. res = urllib.request.urlopen(request)
    
18. js = res.read().decode('utf-8')
    
19. print(js)
    
20. #分析数据自己写吧

复制代码

亚瑟与精灵

kaohsing 发表于 2019-12-4 11:50

可以讲解一下您url；headers；request吗

kaohsing

url是通过抓包获得的。
至于urllib.request.Request，三言两语，讲不清，请百度

Dear_Merlin

kaohsing 发表于 2019-12-4 11:50

谢谢，这是我的分析数据

1. import urllib.request
   
2. import pickle
   
3. import time
   
4. import json
   
5. pickle_file = open('F:\\TestRoad\\2021-04--小甲鱼Python学习\\47天气预报\\city_data.pkl','rb')
   
6. city = pickle.load(pickle_file)
   
7. 
   
8. password = input('请输入城市:')
   
9. cityid = city[password]
   
10. 
    
11. url = r'http://d1.weather.com.cn/weather_index/{}.html?_={}'.format(cityid, str(int(time.time() * 1000)))
    
12. headers = {
    
13.     'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3947.100 Safari/537.36',
    
14.     'Referer': 'http://www.weather.com.cn/weather1d/{}.shtml'.format(cityid)
    
15. }
    
16. request = urllib.request.Request(url=url, headers=headers)
    
17. res = urllib.request.urlopen(request)
    
18. js = res.read().decode('utf-8')
    
19. #js = res.read().decode('unicode_escape')
    
20. weather_info = js.split(';',1)[0]
    
21. weather_info = weather_info.split('=', 1)[1]
    
22. weather_dict = json.loads(weather_info)
    
23. print('天气:', weather_dict.get('weatherinfo').get('weather'))
    
24. 
    
25. #print(weather_dict)
    
26. 
    
27. 
    

复制代码