关于爬淘宝数据课程的字符编码问题

hostmi

with open("items.txt", "w", encoding="utf-8") as file:


代码里面有这样一句，如果目标网站编码是GBK怎么办呢，我试过把 utf-8 修改成gbk，结果运行就出错了，
还是说gbk需要其他模块来解析呢

1. Traceback (most recent call last):
   
2.   File "C:\Users\admin\Desktop\py\taobao-book.py", line 22, in <module>
   
3.     main()
   
4.   File "C:\Users\admin\Desktop\py\taobao-book.py", line 19, in main
   
5.     file.write(res.text)
   
6. UnicodeEncodeError: 'gbk' codec can't encode character '\xa1' in position 231: illegal multibyte sequence

复制代码

新手·ing

1. with open("items.txt", "w", encoding="GB18030") as file:

复制代码

hostmi

新手·ing 发表于 2017-11-9 21:10

还是一样乱码，为什么不用直接用GBK或者gb2312呢

新手·ing

1. decode('utf-8', 'ignore')

复制代码