[已解决]关于爬虫的问题

H.E.G.

又白白在fishc混了一个月
问题又来了
刚刚看小甲鱼的MV，学着编一下代码，但是爬到的字典是那样的
↓代码如下↓

1. #对应小甲鱼的0基础入门学习Python（P56）
   
2. from urllib import request
   
3. from urllib import parse
   
4. import json
   
5. 
   
6. temp = input('Enter you want to translation content:')
   
7. url = 'http://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule&smartresult=ugc&sessionFrom=http://www.youdao.com/'
   
8. 
   
9. head = {}#设置header
   
10. head['User-Agent'] = 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.90 Safari/537.36 Edg/89.0.774.63'
    
11. 
    
12. data = {}#设置爬虫数据
    
13. data['type']='AUTO'
    
14. data['i']=temp
    
15. data['doctype']='json'
    
16. data['xmlVersion']='1.6'
    
17. data['keyfrom']='fanyi.web'
    
18. data['ue']='UFT-8'
    
19. data['typoResult']='true'
    
20. data = parse.urlencode(data).encode('utf-8')
    
21. 
    
22. req = request.Request(url,data,head)#返回
    
23. response = request.urlopen(req)
    
24. html = response.read().decode('utf-8')
    
25. 
    
26. target = json.loads(html)
    
27. print(target)
    
28. res = target['translateResult'][0][0]['tgt']
    
29. print(res)

复制代码

爬到的结果

1. Enter you want to translation content:你好
   
2. {'type': 'UNSUPPORTED', 'errorCode': 30, 'elapsedTime': 2, 'translateResult': [[{'src': '您的请求来源非法，商业用途使用请关注有道翻译API官方网站“有道智云”: http://ai.youdao.com', 'tgt': '您的请求来源非法，商业用途使用请关注有道翻译API官方网站“有道智云”: http://ai.youdao.com'}]]}
   
3. 您的请求来源非法，商业用途使用请关注有道翻译API官方网站“有道智云”: http://ai.youdao.com

复制代码

最佳答案

月排行榜 / 总排行榜

suchocolate

2021-4-3 21:33:22

供参考

1. from urllib import request, parse
   
2. import json
   
3. 
   
4. 
   
5. def main():
   
6.     trans = 'http://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule'
   
7.     headers = {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:72.0) Gecko/20100101 Firefox/72.0"}
   
8.     dic = {"doctype": "json"}
   
9.     wd = input('请输入要翻译的内容: ')
   
10.     dic['i'] = wd
    
11.     data = bytes(parse.urlencode(dic), encoding='utf-8')
    
12.     q = request.Request(url=trans, data=data, headers=headers, method='POST')
    
13.     r = request.urlopen(q)
    
14.     result = json.loads(r.read().decode('utf-8'))
    
15.     print(result['translateResult'][0][0]['tgt'])
    
16. 
    
17. 
    
18. if __name__ == '__main__':
    
19.     main()
    

复制代码

跳转到最佳答案楼层

yayc_zcyd

这些网页特别讨厌爬虫

suchocolate

供参考

1. from urllib import request, parse
   
2. import json
   
3. 
   
4. 
   
5. def main():
   
6.     trans = 'http://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule'
   
7.     headers = {"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:72.0) Gecko/20100101 Firefox/72.0"}
   
8.     dic = {"doctype": "json"}
   
9.     wd = input('请输入要翻译的内容: ')
   
10.     dic['i'] = wd
    
11.     data = bytes(parse.urlencode(dic), encoding='utf-8')
    
12.     q = request.Request(url=trans, data=data, headers=headers, method='POST')
    
13.     r = request.urlopen(q)
    
14.     result = json.loads(r.read().decode('utf-8'))
    
15.     print(result['translateResult'][0][0]['tgt'])
    
16. 
    
17. 
    
18. if __name__ == '__main__':
    
19.     main()
    

复制代码

龙舞九天