[已解决]网页爬取出错

fytfytf · 发表于 2020-7-23 21:56:17

马上注册，结交更多好友，享用更多功能^_^

您需要登录才可以下载或查看，没有账号？立即注册

x

import requests
import bs4
def open_url(url):
headers = {"user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.132 Safari/537.36"}
r=requests.get(url,headers=headers)
return r
def main():
game_url='https://www.bilibili.com/v/game/'
res=open_url(game_url)
with open('bilibiliweb.txt','w') as f:
f.write(res.text)
if __name__=='__main__':
main()

复制代码

这个编码一直出错，求解

最佳答案

月排行榜 / 总排行榜

Twilight6

2020-7-23 21:59:23

写入编码改为 utf-8 就好了：

import requests

import bs4

def open_url(url):

headers = {"user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.132 Safari/537.36"}

r=requests.get(url,headers=headers)

return r

def main():

game_url='https://www.bilibili.com/v/game/'

res=open_url(game_url)

with open('bilibiliweb.txt','w',encoding='utf-8') as f:

f.write(res.text)

if __name__=='__main__':

main()
复制代码

跳转到最佳答案楼层

Twilight6 · 发表于 2020-7-23 21:59:23

这个最佳答案由 Twilight6 给出，感谢 Twilight6 的回答。

单击隐藏图章

写入编码改为 utf-8 就好了：

import requests

import bs4

def open_url(url):

headers = {"user-agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.132 Safari/537.36"}

r=requests.get(url,headers=headers)

return r

def main():

game_url='https://www.bilibili.com/v/game/'

res=open_url(game_url)

with open('bilibiliweb.txt','w',encoding='utf-8') as f:

f.write(res.text)

if __name__=='__main__':

main()
复制代码

账号		自动登录	找回密码
密码			立即注册