[已解决]设置代理失败,很困惑

神奇的yxq

代码如下:

1. import urllib.request
   
2. import pickle
   
3. import random
   
4. import re
   
5. 
   
6. 
   
7. url = "http://myip.kkcha.com/"
   
8. ip_pat = re.compile("\d{3}\.\d{3}\.\d{3}\.\d{3}")
   
9. print("connecting...")
   
10. response = urllib.request.urlopen(url)
    
11. print("reading...")
    
12. content = response.read()
    
13. print("decoding...")
    
14. html = content.decode("utf-8")
    
15. print("无代理:",ip_pat.findall(html))
    
16. 
    
17. 
    
18. with open("proxy_ip_list.pickle","rb") as f:
    
19.     ip_list = pickle.load(f)
    
20.     print("proxy ip had loaded! nums=",len(ip_list))
    
21. ip = random.choice(ip_list)
    
22. proxy = urllib.request.ProxyHandler({ip[0]:ip[1]})
    
23. opener = urllib.request.build_opener(proxy)
    
24. opener.addheaders = [("Connection","keep-alive"),("User-Agent","Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36 QIHU 360EE")]
    
25. urllib.request.install_opener(opener)
    
26. 
    
27. req = urllib.request.Request(url)
    
28. print("connecting...")
    
29. response2 = urllib.request.urlopen(req)
    
30. print("reading...")
    
31. content2 = response2.read()
    
32. print("decoding...")
    
33. html2 = content2.decode("utf-8")
    
34. print("代理:",ip_pat.findall(html2))
    
35. 
    
36. print("代理IP列表")
    
37. for each in ip_list:
    
38.     print(each)

复制代码

问题:
        导入的proxy_ip_list是我用爬虫从西刺爬取的最新的ip列表:http://www.xicidaili.com/.
        按以上代码设置的代理却发现并没有正确的代理.
        运行结果如下:
---------------------------
connecting...
reading...
decoding...
无代理: ['117.151.103.208']
proxy ip had loaded! nums= 100
connecting...
reading...
decoding...
代理: ['117.151.103.208']
代理IP列表
('HTTP', '117.78.37.198:8000')
('HTTPS', '110.73.43.36:8123')
...ip列表省略
----------------------------

不知道到底时哪出问题了  如果是代理服务器出了问题那应该无反应才对啊

最佳答案

月排行榜 / 总排行榜

ba21

2017-10-11 13:04:56

代理IP不行吧

跳转到最佳答案楼层

ba21

代理IP不行吧