[已解决]旧版第55讲[爬虫]有道翻译返回的值是整个网页而不是翻译结果？

安东诺夫 · 发表于 2020-8-14 05:04:21

马上注册，结交更多好友，享用更多功能^_^

您需要登录才可以下载或查看，没有账号？立即注册

x

本帖最后由安东诺夫于 2020-8-14 05:06 编辑

我的代码:
import urllib.request as r
import urllib.parse as p
import json

content = input('输入需要翻译的内容:')
url = 'http://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule'
data = {}
data['i']: content
data['from']: 'en'
data['to']: 'zh-CHS'
data['smartresult']: 'dict'
data['client']: 'fanyideskweb'
data['salt']: '15973481492248'
data['sign']: '17fd1500de801cd7d934942cff5e19f8'
data['lts']: '1597348149224'
data['bv']: '3b8d467d426f612bd369aee663a42d43'
data['doctype']: 'json'
data['version']: '2.1'
data['keyfrom']: 'fanyi.web'
data['action']: 'FY_BY_REALTlME'
data1 = p.urlencode(data).encode()

response = r.urlopen(url,data1)
html = response.read().decode('utf-8')

target = json.loads(html)
print('翻译结果:%s' % target['translateresult'][0][0]['tgt'])

——————————————————分割——————————————————————
上课的时候按照小甲鱼的跟着打的，data是自己在查看网页代码的哪里弄下来的，按理说应该不会有问题但返回的却是：（下面）
这应该是整个网页啊
搞不懂

求解？？

共444行：
<!DOCTYPE html>
<html xmlns="http://www.w3.org/1999/xhtml">
<head>

<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1" />
<title>在线翻译_有道</title>
<meta name="keywords" content="在线翻译"/>
<meta name="description" content="有道翻译提供即时免费的中文、英语、日语、韩语、法语、德语、俄语、西班牙语、葡萄牙语、越南语、印尼语、意大利语全文翻译、网页翻译、文档翻译服务。"/>
<meta name="viewport" content="width=device-width, initial-scale=1.4, minimum-scale=1.0, maximum-scale=2.0"/>
<link rel="canonical" href="http://fanyi.youdao.com"/>
<link href="http://shared.ydstatic.com/plugins/search-provider.fanyi.xml" title="有道翻译" type="application/opensearchdescription+xml" rel="search"/>
<link rel="shortcut icon" href="http://shared.ydstatic.com/images/favicon.ico" type="image/x-icon" />
         <link href="http://shared.ydstatic.com/fanyi/newweb/v1.0.28/styles/newweb/fanyi-newweb.min.css" rel="stylesheet" type="text/css"/>


</head>
<body class="fanyi-page">
<div class="fanyi__nav">
      <div class="fanyi__nav__container">

<ul class="fanyi__nav__list">
<li><a class='nav__tongchuan' target="_blank" href="http://tongchuan.youdao.com/?keyfrom=fanyi_web_tab">同传<span class='tongchuan_new'>new</span></a></li>
<li><a target="_blank"
href="http://dict.youdao.com/appapi/redirect?redirectUrl=http%3A%2F%2Fyou.163.com%2Fitem%2Fdetail%3Fid%3D3394027%26from%3Dweb_hz_neibu_fyw_16&keyfrom=fyw_youdaofanyi&vendor=top">翻译机</a></li>
<li class="nav__rengong">
      <a target="_blank" href="http://f.youdao.com/?vendor=fanyi-new-nav">人工翻译</a>
      <div class="rengong__guide">
         <a target="_blank" class="rengong__guide--con" href="http://f.youdao.com/?vendor=new-fanyicover">
            <span class="tips__pointer tips__pointer--up"></span>
            <div class="rengong__guide--title"><span class="red-strong">网易自营</span>人工翻译服务，专业、精准、地道！</div>
               <div class="rengong__guide__subtitle">精选全球上万名译员实时待命，专家审校，母语润色。严格质量<br/>
               把控，多重售后保障，让您翻译无忧！</div>
            <div class="rengong__guide--list--container">
            <div class="rengong__guide--list">
                  <div class="rengong__guide--sub">快速翻译</div>
                  <div class="rengong__guide__description left">
                     最快1分钟，
                     <br/>
                     立等可取！
                  </div>
            </div>
            <div class="rengong__guide--list">
                  <div class="rengong__guide--sub">文档翻译</div>
                  <div class="rengong__guide__description middle">
                  精准匹配译员，
                  <br/>
                  多重质量把控！
                  </div>
            </div>
            <div class="rengong__guide--list rengong__guide--list--right">
                  <div class="rengong__guide--sub">母语润色</div>
                  <div class="rengong__guide__description right">
                  涵盖上千学科，
                  <br />
                  母语专家润色！
                  </div>
            </div>
            </div>

         </a>
         <a class="i-know" href="javascript:;">我知道了</a>
      </div>
</li>
<li><a target="_blank" href="http://ai.youdao.com/?keyfrom=fanyi-new-nav">翻译API</a></li>
<li><a target="_blank" href="http://fanyiguan.youdao.com/?vendor=fanyi-new-nav">翻译APP</a></li>
         <li class="last">
         <a class="login-link" href="javascript:;">登录</a>
      </li>
</ul>
         <a href="/?keyfrom=fanyi-new.logo" class="fanyi__nav__logo"></a>
      </div>
</div>
<div class="fanyi">
      <div class="fanyi__operations">
         <div class="fanyi__operations--right">
            <span class="fanyi__operations--underline">
                  <label for="underlineWord">划词</label>
            </span>
         </div>
         <div class="fanyi__operations--left">
            <div id="langSelect" class="lang-select item-select">
                  <span class="select-text">自动检测语言</span>
                  <ul id="languageSelect" class="select clear">
                     <li class="default selected" data-value="AUTO"><a href="javascript:;">自动检测语言</a></li>
                     <li data-value="zh-CHS2en"><a href="javascript:;">中文  »  英语</a></li>
                     <li data-value="en2zh-CHS"><a href="javascript:;">英语  »  中文</a></li>
                     <li data-value="zh-CHS2ja"><a href="javascript:;">中文  »  日语</a></li>
                     <li data-value="ja2zh-CHS"><a href="javascript:;">日语  »  中文</a></li>
                     <li data-value="zh-CHS2ko"><a href="javascript:;">中文  »  韩语</a></li>
                     <li data-value="ko2zh-CHS"><a href="javascript:;">韩语  »  中文</a></li>
                     <li data-value="zh-CHS2fr"><a href="javascript:;">中文  »  法语</a></li>
                     <li data-value="fr2zh-CHS"><a href="javascript:;">法语  »  中文</a></li>
                     <li data-value="zh-CHS2de"><a href="javascript:;">中文  »  德语</a></li>
                     <li data-value="de2zh-CHS"><a href="javascript:;">德语  »  中文</a></li>
                     <li data-value="zh-CHS2ru"><a href="javascript:;">中文  »  俄语</a></li>
                     <li data-value="ru2zh-CHS"><a href="javascript:;">俄语  »  中文</a></li>
                     <li data-value="zh-CHS2es"><a href="javascript:;">中文  »  西班牙语</a></li>
                     <li data-value="es2zh-CHS"><a href="javascript:;">西班牙语  »  中文</a></li>
                     <li data-value="zh-CHS2pt"><a href="javascript:;">中文  »  葡萄牙语</a></li>
                     <li data-value="pt2zh-CHS"><a href="javascript:;">葡萄牙语  »  中文</a></li>
                     <li data-value="zh-CHS2it"><a href="javascript:;">中文  »  意大利语</a></li>
                     <li data-value="it2zh-CHS"><a href="javascript:;">意大利语  »  中文</a></li>
                     <li data-value="zh-CHS2vi"><a href="javascript:;">中文  »  越南语</a></li>
                     <li data-value="vi2zh-CHS"><a href="javascript:;">越南语  »  中文</a></li>
                     <li data-value="zh-CHS2id"><a href="javascript:;">中文  »  印尼语</a></li>
                     <li data-value="id2zh-CHS"><a href="javascript:;">印尼语  »  中文</a></li>
                     <li data-value="zh-CHS2ar"><a href="javascript:;">中文  »  阿拉伯语</a></li>
                     <li data-value="ar2zh-CHS"><a href="javascript:;">阿拉伯语  »  中文</a></li>
                  </ul>
                  <input class="select-input" id="language" name="language" type="hidden" value="AUTO">
            </div>
            <a class="fanyi__operations--machine" id="transMachine" href="javascript:;">翻译</a>
            <a class="fanyi__operations--man clog-js" data-clog="AT_BUTTON_CLICK" data-pos="web.i.top" id="transMan" href="javascript:;">人工翻译</a>
            <div class="tips__container fanyi__operations--man--tips">
                  <span class="tips__pointer tips__pointer--up"></span>
                  <p>专业译员随时待命<br/>最快1分钟返回精准译文</p>
                  <p class="man__tips--new">【母语润色服务全新上线】</p>
            </div>
         </div>
         <div class="fanyi-error-message"></div>
      </div>
      <div class="fanyi__input">
         <div class="input__original">
            <div class="fanyi__input__bg">
                  <div id="docUploadBg" class="doc__upload--bg hidden">
                     <span class="doc-type"></span>
                     <div class="doc-infos">
                        <p class="doc-name"></p>
                        <span class="doc-error-msg hidden"></span>
                        <span class="doc-size-msg hidden"></span>
                     </div>
                     <a class="doc-delete" href="javascript:;"></a>
                  </div>
                  <div id="docUploadCon" class="doc__upload--con">
                     <form id="docUploadForm" action1="http://ns013x.corp.youdao.com:13288/doc/upload" action="https://doctrans-service.youdao.com/trandoc/doc/upload" method="post" enctype="multipart/form-data">
                        <span>文档翻译</span>
                        <span class="circle"></span>
                        <input name="your_file" disabled="disabled" type="file" id="docUploadFile" class="doc__upload--file"/>
                        <div class="doc__upload--tip">
                              <span>全新中英文档互译</span>
                              <a href="javascript:;" class="doc__upload--close">×</a>
                        </div>
                        <div class="file__type--tips tips__container speaker__tips">
                              <span class="tips__pointer tips__pointer--down"></span>
                              <span>上传文档一键翻译，译文保留原文排版 <br>
                              目前支持Word、PDF以及幻灯片文档</span>
                        </div>
                     </form>
                  </div>
                  <a id="inputDelete" class="input__original_delete"></a>
                  <div id="inputOriginalCopy" class="input__original__area"></div>
                  <textarea id="inputOriginal" dir="auto" class="input__original__area" placeholder="请输入你要翻译的文字或网址"></textarea>
                  <div class="input__original__bar">
                     <div class="input__original__bar--fonts">
                        <span class="fonts__over">0</span>/<span class="fonts__limited">5000</span>
                     </div>
                     <a href="javascript:;" id="originalSpeaker" class="speaker">
                        <div class="tips__container speaker__tips">
                              <span class="tips__pointer tips__pointer--down"></span>
                              <span class="tips__text--short">朗读</span>
                        </div>
                     </a>
                  </div>
            </div>
            <div class="fanyi__popularize">
                  <a href="javascript:;" target="_blank" class="clog-js" data-clog="AD_TEXT_CLICK"></a>
            </div>
         </div>
         <div class="input__target">
            <div class="fanyi__input__bg">
                  <div id="docLangTip" class="doc-lang-tip">选择翻译语言，然后点击翻译按钮，即可翻译文档</div>
                  <div class="input__target__error" id="inputTargetError"></div>
                  <div id="transTarget" dir="auto" class="input__target__text"></div>
                  <textarea id="transTargetArea" class="input__target__text"></textarea>
                  <div class="input__target__bar">
                     <a class="target__bar__update" id="updateResult">修改翻译结果</a>
                     <a href="javascript:;" id="targetSpeaker" class="speaker target__bar__parts">
                        <div class="tips__container speaker__tips">
                              <span class="tips__pointer tips__pointer--down"></span>
                              <span class="tips__text--short">朗读</span>
                        </div>
                     </a>
                     <a href="javascript:;" id="targetCopy" class="copy target__bar__parts">
                        <div class="tips__container speaker__tips">
                              <span class="tips__pointer tips__pointer--down"></span>
                              <span class="tips__text--short">复制</span>
                        </div>
                     </a>
                     <a href="javascript:;" id="targetStar" class="star target__bar__parts">
                        <div class="tips__container speaker__tips" id="targetStarTip">
                              <span class="tips__pointer tips__pointer--down"></span>
                              <div class="tips__text--short">翻译结果打分</div>
                              <div class="star-con">
                                 <span></span>
                                 <span></span>
                                 <span></span>
                                 <span></span>
                                 <span></span>
                              </div>
                        </div>
                     </a>
                  </div>
                  <div class="input__update__suggest">您提供的翻译将用于改善翻译质量，感谢您的建议！</div>
                  <div class="input__target__dict">
                     <span class="resource">来自有道词典结果</span>
                     <div class="dict__word">
                        <span class="dict__word--letters">美丽</span>
                        <span class="dict__word--phonetic">[měi lì]</span>
                     </div>
                     <div class="dict__relative">
                        <a>comeliness</a>
                        <a>fairness</a>
                        <a>goodliness</a>
                        <a>loveliness</a>
                     </div>
                     <a class="dict__more clog-js" data-clog="RESULT_DICT_ALL_CLICK" href="javascript:;" target="_blank" >查看完整结果>></a>
                  </div>
            </div>
            <div class="fanyi__update__tip"><span class="pointer"></span>点击可查看其他翻译结果，或修改结果</div>
            <div class="fanyi__suggest__container" id="fanyiSuggest">
                  <div class="suggest__title">
                     <div class="suggest__title--text">以下为该句多个翻译结果：</div>
                     <a class="suggest__title--close" href="javascript:;"></a>
                  </div>
                  <ul>
                                                                                                                                          </ul>
                  <div class="suggest__update__con">
                     <a href="javascript:;" class="suggest__update__btn">改进此翻译</a>
                  </div>
            </div>
            <div class="input__target__update">
                  <a class="update__sure update-disable"  href="javascript:;">确认修改</a>
                  <a class="update__cancel" href="javascript:;">取消</a>
            </div>
            <div class="download__area">
                  <a target="_blank" href="http://f.youdao.com/?vendor=fanyibanner">
                     <div class="fanyi__banner--title">试试有道人工翻译？</div>
                     <div class="fanyi__banner--desc">精选同行业资深译员，专家审校润色，让你尊享快捷又准确的人工翻译！</div>
                     <span class="fanyi__banner--btn">立即体验</span>
                  </a>
            </div>
         </div>
      </div>
      <div class="inside__products">

      </div>
                                          </div>
<form id="mapForm" target="_blank" method="POST" action="http://f.youdao.com/?path=fanyi&vendor=new-fanyiinput">
      <input id="mapInput" type="hidden" name="text" value=""/>
</form>
<div class="fanyi__footer">
   <a target="_blank" href="http://www.youdao.com/?keyfrom=fanyi-new.copyright">有道首页</a><span class="c_fnl">|</span><a target="_blank" href="http://dsp.youdao.com/?keyfrom=fanyi-new.copyright">有道智选</a><span class="c_fnl">|</span><a target="_blank" href="https://ke.youdao.com/?keyfrom=fanyi-new.copyright">有道精品课</a><span class="c_fnl">|</span><a target="_blank" href="http://www.youdao.com/about/index.html">关于有道</a><span class="c_fnl">|</span><a target="_blank" href="http://i.youdao.com">官方博客</a>
   <p class="c_fcopyright">© 2020 网易公司 <a href="http://www.163.com/">网易公司</a> <a href="http://www.youdao.com/terms/privacy.html">隐私政策</a> 京ICP证080268号 <a href="http://beian.miit.gov.cn">京ICP备10005211号</a> </p>
</div>
<div class="side__nav">
      <div class="rengong-weixin">
         <span class="tips__pointer tips__pointer--right"></span>
         扫描二维码<br/>
         关注有道人工翻译
      </div>
      <div class="side__nav__content">
         <a href="javascript:;" class="side__nav__fanyiguan">
            <div class="fanyiguan_qrcode">
                  <div class="title">下载有道翻译官</div>
                  <div class="subtitle">107种语言的随身翻译</div>
                  <div class="qrcode_image"></div>
                  <span class="pointer"></span>
            </div>
         </a>
         <a href="http://f.youdao.com/?vendor=new-fanyientrance" target="_blank" class="side__nav__flow">
            <div class="hover_window">有道人工翻译</div>
         </a>
         <a target="_blank" href="http://survey2.163.com/html/fanyis201103a2/paper.html?id=-1530018916@10.169.0.83@0" class="side__nav__feedback">
            <div class="hover_window">满意度调查</div>
         </a>
      </div>
      <a href="javascript:;" class="side__nav__backtop"></a>
</div>
<div id="YOUDAO_SELECTOR_WRAPPER" bindTo="inputOriginal:transTarget"
      style="display:none; z-index: 101; margin:0; border:0; padding:0; width:320px; height:240px;"></div>
<div class="less-ie8-tip">请在IE8以上版本，或Chrome、火狐、Safari等浏览器中访问该网页。</div>
<div class="dict-download-guide">
      <div class="guide-con">
         <a href="javascript:;" target="_blank" class="download-guide-link">
            <img class="download-guide-img" src="http://shared.ydstatic.com/images/favicon.ico"/>
         </a>
         <span class="guide-close"></span>
      </div>
</div>
<audio id="playVoice" style="position:absolute;top:-999px;left:-999px;width:1px;height:1px;"></audio>
<div class="upload__cover">
      <div class="upload__cover--content">
         <div class="upload__cover--title"><span class="upload__percent"></span>解析中</div>
         <div class="upload__filename"></div>
         <div class="upload__progress--con">
            <div class="upload__progress"></div>
         </div>
         <a class="upload--cancel" href="javascript:;">取消</a>
      </div>
</div>
<div id="dialogCover" class="dialog-cover"></div>
<div id="loginAlert" class="dialog-alert">
      <a href="javascript:;" class="dialog-alert--close"></a>
      <div class="title">如需使用文档翻译功能，请先登录。</div>
      <div class="content"></div>
      <div class="btns-con">
      <a href="javascript:;" class="cancel">取消</a>
      <a href="javascript:;" class="ok">确定</a></div>
</div>
<div id="loginWindow" class="dialog-alert">
      <a href="javascript:;" class="dialog-alert--close"></a>
      <h3 class="login-title">使用网易邮箱登录</h3>
      <div class="content urs-login-content" ></div>
      <div class="other third-login">
         <a class="third-login-weixin">
            <img src="http://shared.ydstatic.com/fanyi/login/images/weixin@2x.png" alt="微信登录" title="微信登录" height="44"/>
         </a>
         <a class="third-login-weibo">
            <img src="http://shared.ydstatic.com/fanyi/login/images/weibo@2x.png" alt="新浪微博登录" title="新浪微博登录" height="44"/>
         </a>
         <a class="third-login-qq">
            <img src="http://shared.ydstatic.com/fanyi/login/images/qq@2x.png" alt="QQ帐号登录" title="QQ帐号登录" height="44" />
         </a>
      </div>
</div>

<script>
var _rlog = _rlog || [];
// 指定 product id
_rlog.push(["_setAccount" , "fanyiweb"]);
</script>
<script defer src="http://shared.ydstatic.com/js/rlog/v1.js"></script>

</body>
<script type="text/javascript">
var global = {};
</script><script type="text/javascript" src="http://shared.ydstatic.com/api/fanyi-web/assets/index.min.js" charset="utf-8"></script>
<script type="text/javascript" src="http://shared.ydstatic.com/fanyi/newweb/v1.0.28/scripts/newweb/fanyi.min.js"></script>
</html>

最佳答案

月排行榜 / 总排行榜

zltzlt

2020-8-14 06:10:07

1. 对字典中的键赋值应该使用引号不是冒号
2. 这样做有可能被反爬，帮你加了个 headers
3. 是 translateResult 不是 translateresult

代码帮你改好了：

import urllib.request as r
import urllib.parse as p
import json

content = input('输入需要翻译的内容:')
url = 'http://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule'
data = {}
data['i'] = content
data['from'] = 'en'
data['to'] = 'zh-CHS'
data['smartresult'] = 'dict'
data['client'] = 'fanyideskweb'
data['salt'] = '15973481492248'
data['sign'] = '17fd1500de801cd7d934942cff5e19f8'
data['lts'] = '1597348149224'
data['bv'] = '3b8d467d426f612bd369aee663a42d43'
data['doctype'] = 'json'
data['version'] = '2.1'
data['keyfrom'] = 'fanyi.web'
data['action'] = 'FY_BY_REALTlME'
data1 = p.urlencode(data).encode()
headers = {'User-Agent': 'Mozilla/5.0'}

response = r.urlopen(r.Request(url, headers=headers),data1)
html = response.read().decode('utf-8')

target = json.loads(html)
print('翻译结果:%s' % target['translateResult'][0][0]['tgt'])

跳转到最佳答案楼层

zltzlt · 发表于 2020-8-14 06:10:07

这个最佳答案由 zltzlt 给出，感谢 zltzlt 的回答。

单击隐藏图章

1. 对字典中的键赋值应该使用引号不是冒号
2. 这样做有可能被反爬，帮你加了个 headers
3. 是 translateResult 不是 translateresult

代码帮你改好了：

import urllib.request as r
import urllib.parse as p
import json

content = input('输入需要翻译的内容:')
url = 'http://fanyi.youdao.com/translate?smartresult=dict&smartresult=rule'
data = {}
data['i'] = content
data['from'] = 'en'
data['to'] = 'zh-CHS'
data['smartresult'] = 'dict'
data['client'] = 'fanyideskweb'
data['salt'] = '15973481492248'
data['sign'] = '17fd1500de801cd7d934942cff5e19f8'
data['lts'] = '1597348149224'
data['bv'] = '3b8d467d426f612bd369aee663a42d43'
data['doctype'] = 'json'
data['version'] = '2.1'
data['keyfrom'] = 'fanyi.web'
data['action'] = 'FY_BY_REALTlME'
data1 = p.urlencode(data).encode()
headers = {'User-Agent': 'Mozilla/5.0'}

response = r.urlopen(r.Request(url, headers=headers),data1)
html = response.read().decode('utf-8')

target = json.loads(html)
print('翻译结果:%s' % target['translateResult'][0][0]['tgt'])

安东诺夫 · 发表于 2020-8-14 21:11:08

zltzlt 发表于 2020-8-14 06:10
1. 对字典中的键赋值应该使用引号不是冒号
2. 这样做有可能被反爬，帮你加了个 headers
3. 是 translateR ...

感谢大神，搞定了，已采纳，非常感谢！

账号		自动登录	找回密码
密码			立即注册