[已解决]python爬虫代码问题

木鱼加小鱼

jerryxjr1220 发表于 2017-4-30 16:26
data['salt'] = '1493538230701'  这个应该是个时间戳，
data['sign'] = '7b50be5ddda95bce3d4b7b9404647c ...

使用提供的第一种方法，返回的是{"type":"EN2ZH_CN","errorCode":30,"elapsedTime":0,"translateResult":[[{"src":"您的请求来源非法，商业用途使用请关注有道翻译API官方网站\u201C有道智云\u201D: http:\/\/ai.youdao.com","tgt":"您的请求来源非法，商业用途使用请关注有道翻译API官方网站\u201C有道智云\u201D: http:\/\/ai.youdao.com"}]]}

东海神皇

1304539791 发表于 2017-7-15 19:26
只要把07.url = 'http://fanyi.youdao.com/translate_o?smartresult=dict&smartresult=rule&sessionFrom=nu ...

可是我的去掉‘_o’,出现的是ValueError,这是怎么回事啊

石小龙

1304539791 发表于 2017-7-15 19:26
只要把07.url = 'http://fanyi.youdao.com/translate_o?smartresult=dict&smartresult=rule&sessionFrom=nu ...

大神啊，我终于搞定了

lymadnzlh

代码如下：
import urllib.request
import urllib.parse
import json
head = {}
head['User-Agent'] = 'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.104 Mobile Safari/537.36'

url = 'http://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule&smartresult=ugc'
data = {}
data['i'] = 'I love Fish'
data['type'] = 'AUTO'
data['ue'] = 'UTF-8'
data['doctype'] = 'json'
data['xmlVersion'] = '2.1'
data['keyfrom'] = 'fanyi.web'
data['action'] = 'FY_BY_REALTIME'
data['typoResult'] = 'true'

data =  urllib.parse.urlencode(data).encode('utf-8')
response = urllib.request.urlopen(url,data,head)

html = response.read().decode('utf-8')
print(html)

报错信息如下，各位帮忙看看是怎么回事？
======================= RESTART: F:/py/translation.py =======================
Traceback (most recent call last):
  File "F:/py/translation.py", line 19, in <module>
    response = urllib.request.urlopen(url,data,head)
  File "D:\Program Files\python3.6.3\lib\urllib\request.py", line 223, in urlopen
    return opener.open(url, data, timeout)
  File "D:\Program Files\python3.6.3\lib\urllib\request.py", line 526, in open
    response = self._open(req, data)
  File "D:\Program Files\python3.6.3\lib\urllib\request.py", line 544, in _open
    '_open', req)
  File "D:\Program Files\python3.6.3\lib\urllib\request.py", line 504, in _call_chain
    result = func(*args)
  File "D:\Program Files\python3.6.3\lib\urllib\request.py", line 1346, in http_open
    return self.do_open(http.client.HTTPConnection, req)
  File "D:\Program Files\python3.6.3\lib\urllib\request.py", line 1318, in do_open
    encode_chunked=req.has_header('Transfer-encoding'))
  File "D:\Program Files\python3.6.3\lib\http\client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "D:\Program Files\python3.6.3\lib\http\client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "D:\Program Files\python3.6.3\lib\http\client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "D:\Program Files\python3.6.3\lib\http\client.py", line 1026, in _send_output
    self.send(msg)
  File "D:\Program Files\python3.6.3\lib\http\client.py", line 964, in send
    self.connect()
  File "D:\Program Files\python3.6.3\lib\http\client.py", line 936, in connect
    (self.host,self.port), self.timeout, self.source_address)
  File "D:\Program Files\python3.6.3\lib\socket.py", line 710, in create_connection
    sock.settimeout(timeout)
TypeError: an integer is required (got type dict)
>>>

数字城堡

骚强么么哒 发表于 2017-9-3 00:54
真的是这个问题。这么发现的？？？？？为什么和_o有关系？？？

666,果然是_o的问题

数字城堡

有人知道为什么翻译短的词句没问题，翻译长的词句就只能翻译前面很少的部分？

lijiyh

还是大神们认真啊

chinalove

好像我也是这个问题。正在解决中

ADME

jerryxjr1220 发表于 2017-4-30 16:26
data['salt'] = '1493538230701'  这个应该是个时间戳，
data['sign'] = '7b50be5ddda95bce3d4b7b9404647c ...

请问URL和data是从哪里找到了，我也是这个问题，但是我的url和data也是从谷歌浏览器里找到的，你的data和ur是怎么找的呢

kuz00

确实是_0的问题啊，去掉就行了，原因是为啥？

帅楠楠

1. import urllib.request
   
2. import urllib.parse
   
3. import json
   
4. 
   
5. 
   
6. content = input("qing  shu  ru:")
   
7. url = 'http://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule&smartresult=ugc'
   
8. 
   
9. head = {}
   
10. head['User-Agent'] = 'Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:60.0) Gecko/20100101 Firefox/60.0'
    
11. 
    
12. data = {
    
13.         "type" : "AUTO",
    
14.         "i" : content,
    
15.         "doctype" : "json",
    
16.         "xmlVersion" : "1.8",
    
17.         "keyfrom" : "fanyi.web",
    
18.         "ue" : "UTF-8",
    
19.         "action" : "FY_BY_CLICKBUTTON",
    
20.         "typoResult" : "true"
    
21.     }
    
22. data = urllib.parse.urlencode(data).encode('utf-8')
    
23. 
    
24. req = urllib.request.Request(url,data,head)
    
25. response = urllib.request.urlopen(req)
    
26. html = response.read().decode('utf-8')
    
27. 
    
28. target = json.loads(html)
    
29. target = target['translateResult'][0][0]['tgt']
    
30. 
    
31. print(target)
    

复制代码

第一次问，有什么不好请说出来，想问各位大神为什么运行后输入翻译内容总提示请求来源非法  不懂！！

Py20180701

我的也是这样

xixi_96

明显有道已经屏蔽了

jennypark

发现一个问题，只要翻译'oracle'这个词，就会返回"errorCode":40 ,搜索了一下应该是“不支持的语言类型”，即使指定了from和to，结果都是一样，怎么破？

import urllib.request
import urllib.parse
content = input("请输入需要翻译的内容：")

url='http://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule'
data={}
data['i'] = content
data['from'] = 'AUTO'
data['to'] = 'AUTO'
data['smartresult'] = 'dict'
data['client'] = 'fanyideskweb'
data['salt'] = '1533171892573'
data['sign'] = 'a61c434ce376dc40dfdd999bc2aaaded'
data['doctype'] = 'json'
data['version'] = '2.1'
data['keyfrom'] = 'fanyi.web'
data['action'] = 'FY_BY_REALTIME'
data['typoResult'] = 'true'


data = urllib.parse.urlencode(data).encode('UTF-8')
print(data)
response = urllib.request.urlopen(url,data)
html = response.read().decode('UTF-8')
print(html)

汝鱼得水

cjb2008508 发表于 2017-7-18 15:00
我也发现了。去掉_o 就可以了，小甲鱼老师视频讲解时候的URL有道是没有_o的，不知道是不是有道的一个模糊 ...

请问那个_o 具体代表什么呢？ 为啥会自动生成？

小文子

Tristan66

为什么和_o有关系？？？

静静静H

1304539791 发表于 2017-7-15 19:26
只要把07.url = 'http://fanyi.youdao.com/translate_o?smartresult=dict&smartresult=rule&sessionFrom=nu ...

十分感谢您！为什么这么神奇，这个纠结了我一个晚上，百度各种方法改了又改，原来是这个小小的_o。只是我不明白为什么这个改鸭

Heather_zero

所有答案看了下了试了一下，果然需要修改的只是去掉request_html的‘_o’就解决问题了，不过原理就不是很清楚了，第一次贴个代码吧

1. import urllib.request
   
2. import urllib.parse
   
3. import easygui as  gui
   
4. import json
   
5. 
   
6. url = 'http://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule'
   
7. data = {}
   
8. data['from'] = 'AUTO'
   
9. data['to'] = 'AUTO'
   
10. data['i'] = 'I love FishC'
    
11. data['doctype'] = 'json'
    
12. data['Version'] = '2.1'
    
13. data['client'] = 'fanyideskweb'
    
14. data['keyform'] = 'fanyi.web'
    
15. data['ue'] = 'UTF-8'
    
16. data['action'] = 'FY_BY_CLICKBUTTON'
    
17. data['typoResult'] = 'true'
    
18. #print(data)
    
19. 
    
20. while True:
    
21.     sentense = gui.enterbox('请输入待翻译内容：', '盗版有道词典')
    
22.     data['i'] = sentense
    
23.     data = urllib.parse.urlencode(data).encode('utf-8')
    
24.     response = urllib.request.urlopen(url, data)
    
25.     html = response.read().decode('utf-8')
    
26.     #print(html)
    
27.     target = json.loads(html)
    
28.     gui.msgbox("%s的翻译结果是：\n\n %s" % (sentense, target['translateResult'][0][0]['tgt']),\
    
29.                title = '盗版有道词典')
    
30.     if gui.ynbox('是否继续翻译：') == False :
    
31.         break
    

复制代码

雪语风

1304539791 发表于 2017-7-15 19:26
只要把07.url = 'http://fanyi.youdao.com/translate_o?smartresult=dict&smartresult=rule&sessionFrom=nu ...

详细的解答可以参考https://blog.csdn.net/li939891142/article/details/84592442