[已解决]叕出问题了，还希望大家帮助一下

mkx1253

1. import urllib.request as urt
   
2. import chardet as ch
   
3. 
   
4. 
   
5. def write_http(num, res, encode):
   
6.     name = 'url_' + str(num) + '.txt'
   
7.     with open(name, 'wt') as each_file:
   
8.         each_file.write(html.decode(encode))
   
9. 
   
10. 
    
11. with open('urls.txt', 'rt') as f:
    
12.     num = 0
    
13.     for each in f:
    
14.         num += 1
    
15.         response = urt.urlopen(each)
    
16.         html = response.read()
    
17.         encode = ch.detect(html)['encoding']
    
18.         if encode == 'GB2312':
    
19.             encode = 'GBK'
    
20. 
    
21.         write_http(num, html, encode)

复制代码

感觉没有太大问题结果出现了一个
UnicodeEncodeError: 'gbk' codec can't encode character '\xbb' in position 29836: illegal multibyte sequence
这样的问题，还希望大家能够解答一下啊。

最佳答案

月排行榜 / 总排行榜

XiaoPaiShen

2019-10-5 05:56:28

1. import urllib.request as urt
   
2. import chardet as ch
   
3. 
   
4. 
   
5. def write_http(num, res, encode):
   
6.     name = 'url_' + str(num) + '.txt'
   
7.    
   
8.     with open(name, 'wt', encoding='utf-8') as each_file:   # 加上encoding
   
9.         each_file.write(res.decode(encode))     # 应该使用res
   
10. 
    
11. 
    
12. with open('urls.txt', 'rt') as f:
    
13.     num = 0
    
14.     for each in f:
    
15.         num += 1
    
16.         response = urt.urlopen(each)
    
17.         html = response.read()        
    
18.         
    
19.         encode = ch.detect(html)['encoding']
    
20.         if encode == 'GB2312':
    
21.             encode = 'GBK'
    
22.         
    
23.         write_http(num, html, encode)

复制代码

跳转到最佳答案楼层

zltzlt

把完整的报错信息贴出来，我运行没有报错。

wp231957

PYTHON2.X??
更换3.x ！！

mkx1253

zltzlt 发表于 2019-10-4 16:44
把完整的报错信息贴出来，我运行没有报错。

Traceback (most recent call last):
  File "D:/BaiduNetdiskDownload/.../test.py", line 21, in <module>
    write_http(num, html, encode)
  File "D:/BaiduNetdiskDownload/.../test.py", line 8, in write_http
    each_file.write(html.decode(encode))
UnicodeEncodeError: 'gbk' codec can't encode character '\xbb' in position 29836: illegal multibyte sequence
这是完整错误信息
urls.txt内文件内容：
http://www.baidu.com
http://www.fishc.com
http://www.douban.com

mkx1253

1. Traceback (most recent call last):
   
2.   File "D:/BaiduNetdiskDownload/.../test.py", line 21, in <module>
   
3.     write_http(num, html, encode)
   
4.   File "D:/BaiduNetdiskDownload/程序文件/.../test.py", line 8, in write_http
   
5.     each_file.write(html.decode(encode))
   
6. UnicodeEncodeError: 'gbk' codec can't encode character '\xbb' in position 29836: illegal multibyte sequence

复制代码

这是整个错误信息
然后文件里有两个网址

XiaoPaiShen

1. import urllib.request as urt
   
2. import chardet as ch
   
3. 
   
4. 
   
5. def write_http(num, res, encode):
   
6.     name = 'url_' + str(num) + '.txt'
   
7.    
   
8.     with open(name, 'wt', encoding='utf-8') as each_file:   # 加上encoding
   
9.         each_file.write(res.decode(encode))     # 应该使用res
   
10. 
    
11. 
    
12. with open('urls.txt', 'rt') as f:
    
13.     num = 0
    
14.     for each in f:
    
15.         num += 1
    
16.         response = urt.urlopen(each)
    
17.         html = response.read()        
    
18.         
    
19.         encode = ch.detect(html)['encoding']
    
20.         if encode == 'GB2312':
    
21.             encode = 'GBK'
    
22.         
    
23.         write_http(num, html, encode)

复制代码