[已解决]如何解决BeautifulSoup解析打印乱码问题

JokerCraker

如题所述，爬取的是知乎的一个页面，为什么会打印出乱码？

                               
登录/注册后可看大图

完整代码如下：

1. import json
   
2. import time
   
3. import requests
   
4. import os
   
5. from bs4 import BeautifulSoup
   
6. 
   
7. # -*- coding:utf-8 -*-
   
8. 
   
9. # 获取cookies
   
10. ckdesk = os.path.join(os.path.expanduser("~"), 'Desktop') + '\\知乎数据更新\\zhihucookie.txt'
    
11. with open(ckdesk,'r') as f :
    
12.     cookie = f.read()
    
13.     f.close()
    
14. cookie = json.loads(cookie)
    
15. print('cookie读取成功')
    
16. desk = os.path.join(os.path.expanduser("~"), 'Desktop') + '\\知乎数据更新\\知乎问答数据.xlsx'
    
17. 
    
18. 
    
19. # url设置
    
20. url = 'https://www.zhihu.com/question/395871463'
    
21. # 请求头
    
22. headers = {
    
23.     'authority': 'www.zhihu.com',
    
24.     'method': 'GET',
    
25.     'path': url.replace("https://www.zhihu.com/", ""),
    
26.     'scheme': 'https',
    
27.     'accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9',
    
28.     'accept-encoding': 'gzip, deflate, br',
    
29.     'accept-language': 'zh-CN,zh;q=0.9,en;q=0.8',
    
30.     'cache-control': 'max-age=0',
    
31.     'referer': url,
    
32.     'sec-fetch-dest': 'document',
    
33.     'sec-fetch-mode': 'navigate',
    
34.     'sec-fetch-site': 'same-origin',
    
35.     'sec-fetch-user': '?1',
    
36.     'upgrade-insecure-requests': '1',
    
37.     'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.116 Safari/537.36'
    
38. }
    
39. # 请求页面，获取数据
    
40. res = requests.get(url=url, cookies=cookie, headers=headers)
    
41. session = requests.session()
    
42. login_response = session.post(url, headers=headers)
    
43. # res.encoding = 'utf-8'
    
44. # print(res.encoding)
    
45. soup = BeautifulSoup(res.text, 'html.parser',)
    
46. print(soup)

复制代码

最佳答案

月排行榜 / 总排行榜

comeheres

2020-7-13 17:35:13

把headers中'accept-encoding': 'gzip, deflate, br'的br去掉

跳转到最佳答案楼层

comeheres

把headers中'accept-encoding': 'gzip, deflate, br'的br去掉

xiaofeiyu

编码问题，把headers里的accept-encoding的值改成utf-8就可以了

JokerCraker

感谢二位大佬，确实可以解决！