求助，练习p14_92问题

charst89

用的python3.7.3
代码

1. import urllib.request
   
2. import urllib.parse
   
3. import re
   
4. from bs4 import BeautifulSoup
   
5. 
   
6. def main():
   
7.         keyword =  input("请输入关键词：")
   
8.         keyword = urllib.parse.urlencode({"word":keyword})
   
9.         response = urllib.request.urlopen("http://baike.baidu.com/search/word?%s" % keyword)
   
10.         html = response.read()
    
11.         soup = BeautifulSoup(html, "html.parser")
    
12. 
    
13.         for each in soup.find_all(href=re.compile("view")):
    
14.                 content =''.join([each.text])
    
15.                 url2 = ''.join(["http://baike.baidu.com", each["href"]])
    
16.                 response2 = urllib.request.urlopen(url2)
    
17.                 html2 = response2.read()
    
18.                 soup2 = BeautifulSoup(html2, "html.parser")
    
19.                 if soup2.h2:
    
20.                         content = ''.join([content, soup2, h2.text])
    
21.                 content  = ''.join([content, "->", url2])
    
22.                 print(content)
    
23. if __name__=="__main__":
    
24.         main()

复制代码

报错

1. RESTART: C:/Users/cgt19/AppData/Local/Programs/Python/Python37-32/p14_92.py
   
2. 请输入关键词：牛
   
3. Traceback (most recent call last):
   
4.   File "C:/Users/cgt19/AppData/Local/Programs/Python/Python37-32/p14_92.py", line 24, in <module>
   
5.     main()
   
6.   File "C:/Users/cgt19/AppData/Local/Programs/Python/Python37-32/p14_92.py", line 16, in main
   
7.     response2 = urllib.request.urlopen(url2)
   
8.   File "C:\Users\cgt19\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 222, in urlopen
   
9.     return opener.open(url, data, timeout)
   
10.   File "C:\Users\cgt19\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 525, in open
    
11.     response = self._open(req, data)
    
12.   File "C:\Users\cgt19\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 543, in _open
    
13.     '_open', req)
    
14.   File "C:\Users\cgt19\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 503, in _call_chain
    
15.     result = func(*args)
    
16.   File "C:\Users\cgt19\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 1345, in http_open
    
17.     return self.do_open(http.client.HTTPConnection, req)
    
18.   File "C:\Users\cgt19\AppData\Local\Programs\Python\Python37-32\lib\urllib\request.py", line 1317, in do_open
    
19.     encode_chunked=req.has_header('Transfer-encoding'))
    
20.   File "C:\Users\cgt19\AppData\Local\Programs\Python\Python37-32\lib\http\client.py", line 1229, in request
    
21.     self._send_request(method, url, body, headers, encode_chunked)
    
22.   File "C:\Users\cgt19\AppData\Local\Programs\Python\Python37-32\lib\http\client.py", line 1240, in _send_request
    
23.     self.putrequest(method, url, **skips)
    
24.   File "C:\Users\cgt19\AppData\Local\Programs\Python\Python37-32\lib\http\client.py", line 1107, in putrequest
    
25.     self._output(request.encode('ascii'))
    
26. UnicodeEncodeError: 'ascii' codec can't encode characters in position 36-39: ordinal not in range(128)

复制代码

charst89

折腾半天修改了一下，能跑起来了
代码

1. import urllib.request
   
2. import re
   
3. from bs4 import BeautifulSoup
   
4. 
   
5. def main():
   
6.     keyword = input("请输入关键词：")
   
7.     keyword = urllib.parse.urlencode({'word':keyword})  
   
8.     response = urllib.request.urlopen('https://baike.baidu.com/search/word?%s' % keyword)
   
9.     html = response.read()
   
10.     soup = BeautifulSoup(html,'html.parser')
    
11.     for each in soup.find_all(href = re.compile('view')):
    
12.         content = ''.join([each.text])
    
13.         [color=Red]keyword2 = urllib.parse.urlencode({'word2':each['href']})[/color]
    
14.         [color=Red]url2 = 'https://baike.baidu.com/%s' % keyword2[/color]
    
15.         response2 = urllib.request.urlopen(url2)
    
16.         html2 = response2.read()
    
17.         soup2 = BeautifulSoup(html2,'html.parser')
    
18.         if soup2.h2:
    
19.             content = ''.join([content,soup2.h2.text])
    
20.         content = ''.join([content,'->',url2])
    
21.         print(content)
    
22. if __name__ == '__main__':
    
23.     main()
    

复制代码

结果

1. RESTART: C:\Users\cgt19\AppData\Local\Programs\Python\Python37-32\p14-93.py
   
2. 请输入关键词：牛
   
3. 恐龙百科->https://baike.baidu.com/word2=%2Fwikicategory%2Fview%3FcategoryName%3D%E6%81%90%E9%BE%99%E5%A4%A7%E5%85%A8
   
4. 多肉百科->https://baike.baidu.com/word2=%2Fwikicategory%2Fview%3FcategoryName%3D%E5%A4%9A%E8%82%89%E6%A4%8D%E7%89%A9
   
5. 力学单位->https://baike.baidu.com/word2=%2Fitem%2F%25E7%2589%259B%2F2620569%23viewPageContent
   
6. 姓氏->https://baike.baidu.com/word2=%2Fitem%2F%25E7%2589%259B%2F2620535%23viewPageContent
   
7. 十二生肖之一->https://baike.baidu.com/word2=%2Fitem%2F%25E7%2589%259B%2F9259224%23viewPageContent
   
8. Minecraft中的生物->https://baike.baidu.com/word2=%2Fitem%2F%25E7%2589%259B%2F14680981%23viewPageContent
   
9. 谭剑飞创作的诗歌->https://baike.baidu.com/word2=%2Fitem%2F%25E7%2589%259B%2F16750946%23viewPageContent
   
10. 《夏目友人帐》中妖怪->https://baike.baidu.com/word2=%2Fitem%2F%25E7%2589%259B%2F16535229%23viewPageContent
    
11. 汉语汉字->https://baike.baidu.com/word2=%2Fitem%2F%25E7%2589%259B%2F1139%23viewPageContent
    
12. 莫言中篇小说->https://baike.baidu.com/word2=%2Fitem%2F%25E7%2589%259B%2F12012478%23viewPageContent
    
13. 杨歌执导的影片->https://baike.baidu.com/word2=%2Fitem%2F%25E7%2589%259B%2F22543405%23viewPageContent
    
14. 更多->https://baike.baidu.com/word2=http%3A%2F%2Fbaike.baidu.com%2Fview%2F830944.htm

复制代码

有其他解决办法的，交流一下呗。

Krant5

上面写了编码不支持了,换个UTF8

charst89

Krant5 发表于 2019-6-15 14:17
上面写了编码不支持了,换个UTF8

一上午就为编码搞事情，没结果，然后自己改，能跑起来了。有高见的求指导！
原程序：
        url2 = ''.join(["http://baike.baidu.com", each["href"]])
        response2 = urllib.request.urlopen(url2)
改成
        keyword2 = urllib.parse.urlencode({'word2':each['href']})
        url2 = 'https://baike.baidu.com/%s' % keyword2
        response2 = urllib.request.urlopen(url2)