[已解决]关于Python课程第54讲爬虫有道，只能爬到网页代码。

airsnowman

代码完全是按照小甲鱼的来弄的，也去掉了_o，就是得不到小甲鱼的效果。

最佳答案

月排行榜 / 总排行榜

白two

2021-8-15 16:25:04

没有加请求头，ua和cookie

跳转到最佳答案楼层

wp231957

放代码

airsnowman

wp231957 发表于 2021-8-15 11:29
放代码

import urllib.request

import urllib.parse

url = "https://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule"

data = {}

data["i"]:" i love fishc.com"
data["from"]: "AUTO"
data["to"]: "AUTO"
data["smartresult"]: "dict"
data["client"]: "fanyideskweb"
data["salt"]: "16289478560301"
data["sign"]: "50f56d58392d0eeb8554f16b02746b3d"
data["lts"]: "1628947856030"
data["bv"]: "eda468fc64295ecf2810ab8a672c2db1"
data["doctype"]: "json"
data["version"]: "2.1"
data["keyfrom"]: "fanyi.web"
data["action"]: "FY_BY_CLICKBUTTION"

data = urllib.parse.urlencode(data).encode("utf-8")

response = urllib.request.urlopen(url,data)

html = response.read().decode("utf-8")
                              
print(html)

白two

没有加请求头，ua和cookie

airsnowman

白two 发表于 2021-8-15 16:25
没有加请求头和cookies

谢谢大佬解答，我去查阅一下相关资料

airsnowman

白two 发表于 2021-8-15 16:25
没有加请求头，ua和cookie

还是不行呢

from urllib import request
import urllib.parse

url = "https://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule"
header = {}
data = {}

header["User-Agent"]="Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.131 Safari/537.36"
header["Cookie"]="OUTFOX_SEARCH_USER_ID=-1404491642@10.108.160.101; OUTFOX_SEARCH_USER_ID_NCOO=847436334.4984028; JSESSIONID=aaaai22Oo32k9_PctWhTx; ___rl__test__cookies=1629016383535"

data["i"]=" i love fishc.com"
data["from"]= "AUTO"
data["to"]= "AUTO"
data["smartresult"]= "dict"
data["client"]= "fanyideskweb"
data["salt"]= "16289478560301"
data["sign"]= "50f56d58392d0eeb8554f16b02746b3d"
data["lts"]= "1628947856030"
data["bv"]= "eda468fc64295ecf2810ab8a672c2db1"
data["doctype"]= "json"
data["version"]= "2.1"
data["keyfrom"]= "fanyi.web"
data["action"]= "FY_BY_CLICKBUTTION"

data = urllib.parse.urlencode(data).encode("utf-8")

response = request.Request(url,headers = header)

res = request.urlopen(response)

html = res.read().decode("utf-8")
                              
print(html)

白two

1. from urllib import request
   
2. import urllib.parse
   
3. 
   
4. url = "https://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule"
   
5. header = {}
   
6. data = {}
   
7. 
   
8. header[
   
9.     "User-Agent"] = "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.131 Safari/537.36"
   
10. header[
    
11.     "Cookie"] = "OUTFOX_SEARCH_USER_ID=-1404491642@10.108.160.101; OUTFOX_SEARCH_USER_ID_NCOO=847436334.4984028; JSESSIONID=aaaai22Oo32k9_PctWhTx; ___rl__test__cookies=1629016383535"
    
12. 
    
13. data["i"] = " i love fishc.com"
    
14. data["from"] = "AUTO"
    
15. data["to"] = "AUTO"
    
16. data["smartresult"] = "dict"
    
17. data["client"] = "fanyideskweb"
    
18. data["salt"] = "16289478560301"
    
19. data["sign"] = "50f56d58392d0eeb8554f16b02746b3d"
    
20. data["lts"] = "1628947856030"
    
21. data["bv"] = "eda468fc64295ecf2810ab8a672c2db1"
    
22. data["doctype"] = "json"
    
23. data["version"] = "2.1"
    
24. data["keyfrom"] = "fanyi.web"
    
25. data["action"] = "FY_BY_CLICKBUTTION"
    
26. 
    
27. data = urllib.parse.urlencode(data).encode("utf-8")
    
28. 
    
29. response = request.Request(url,data, headers=header)
    
30. 
    
31. res = request.urlopen(response)
    
32. 
    
33. html = res.read().decode("utf-8")
    
34. 
    
35. print(html)

复制代码

emmm,第29行，你data根本没提交