爬虫网站无法print出text或者输出到文件内

SylarPu

一下是代码，这个代码是爬去一个网站的。可以通过bs4进行处理，但是无法进行print和write的操作。
怀疑是计算机自身的编码问题。请问有大神可以解答一下么

1. # -*- coding: utf-8 -*-
   
2. 
   
3. import requests,zlib,gzip
   
4. # from pdfkit import *
   
5. import pdfkit
   
6. from io import StringIO
   
7. from bs4 import BeautifulSoup
   
8. import sys
   
9. # sys.setdefaultencoding("utf-8")
   
10. URL="https://daily.zhihu.com"
    
11. 
    
12. 
    
13. def GetUrl(url):
    
14.     header={
    
15.         "Accept-Encoding":"gzip, deflate",
    
16.         "Accept-Language":"zh-CN,zh;q=0.8",
    
17.         "User-Agent":"Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 UBrowser/6.2.3831.602 Safari/537.36"
    
18.     }
    
19.     a=requests.get(url,headers=header)
    
20.     if a.status_code ==200:
    
21.         bs=BeautifulSoup(a.text,"lxml")
    
22.         bs.prettify()
    
23.         return bs
    
24. 
    
25. # def Download(path,)
    
26. bs=GetUrl(URL)
    
27. title=bs.find_all("a",class_="link-button")
    
28. for  i in title:
    
29.     print(i)
    
30.     uid=i["href"]
    
31.     img=i.find("img")["src"]
    
32.     name=i.find("span").text
    
33.     # ir=requests.get(img)
    
34.     # open('text.png',"wb").write(ir.content)
    
35.     break
    
36. 
    
37. print(URL+uid)
    
38. proce=GetUrl(URL+uid)
    
39. a=open("text.html","w")
    
40. a.write(proce.text)
    

复制代码

这是报错

1. <a class="link-button" href="/story/9660557"><img class="preview-image" src="https://pic2.zhimg.com/v2-6be190072ce0664f1549accc74bc51c5.jpg"/><span class="title">伤口愈合这事，你以为简单吧？可是我花了博士四年都还没搞懂</span></a>
   
2. https://daily.zhihu.com/story/9660557
   
3. Traceback (most recent call last):
   
4.   File "D:/OFFICE/learing-program/fishc/chapion/4-4/zhihu.py", line 43, in <module>
   
5.     a.write(proce.text)
   
6. UnicodeEncodeError: 'gbk' codec can't encode character '\xf6' in position 2050: illegal multibyte sequence
   
7. utf-8
   
8. 
   
9. Process finished with exit code 1

复制代码

SylarPu

@wei_Y 为自己艾特一下大神

chakyam

a=open("text.html","w",encoding='utf-8')