[已解决]爬豆瓣被挡

大地郡主

刚才再练习爬豆瓣，可是出现了ValueError: Invalid header name b'User:Agent'这个报错，上网查了下，说是在网页的headers里面有东西前面加了冒号，请问怎样把这个冒号删掉啊

import bs4
import re
import requests

header = {'User:Agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36'}
res = requests.get('https://movie.douban.com/top250',headers = header)
soup = bs4.BeautifulSoup(res.text,'html.parser')
namelist = soup.find_all('div',class_='hd')
for each in namelist:
    print(each.a.span.text)

最佳答案

月排行榜 / 总排行榜

Twilight6

2020-7-27 23:04:39

是 User-Agent 不是 User:Agent

import bs4
import re
import requests

header = {'User-Agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36'}
res = requests.get('https://movie.douban.com/top250',headers = header)
soup = bs4.BeautifulSoup(res.text,'html.parser')
namelist = soup.find_all('div',class_='hd')
for each in namelist:
    print(each.a.span.text)

跳转到最佳答案楼层

Twilight6

是 User-Agent 不是 User:Agent

import bs4
import re
import requests

header = {'User-Agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36'}
res = requests.get('https://movie.douban.com/top250',headers = header)
soup = bs4.BeautifulSoup(res.text,'html.parser')
namelist = soup.find_all('div',class_='hd')
for each in namelist:
    print(each.a.span.text)

大地郡主

Twilight6 发表于 2020-7-27 23:04
是 User-Agent 不是 User:Agent

呃，低级错误谢谢您，我再认真些