[已解决]爬豆瓣被挡

大地郡主

刚才再练习爬豆瓣，可是出现了ValueError: Invalid header name b'User:Agent'这个报错，上网查了下，说是在网页的headers里面有东西前面加了冒号，请问怎样把这个冒号删掉啊

1. import bs4
   
2. import re
   
3. import requests
   
4. 
   
5. header = {'User:Agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36'}
   
6. res = requests.get('https://movie.douban.com/top250',headers = header)
   
7. soup = bs4.BeautifulSoup(res.text,'html.parser')
   
8. namelist = soup.find_all('div',class_='hd')
   
9. for each in namelist:
   
10.     print(each.a.span.text)

复制代码

最佳答案

月排行榜 / 总排行榜

Twilight6

2020-7-27 23:04:39

是 User-Agent 不是 User:Agent

1. import bs4
   
2. import re
   
3. import requests
   
4. 
   
5. header = {'User-Agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36'}
   
6. res = requests.get('https://movie.douban.com/top250',headers = header)
   
7. soup = bs4.BeautifulSoup(res.text,'html.parser')
   
8. namelist = soup.find_all('div',class_='hd')
   
9. for each in namelist:
   
10.     print(each.a.span.text)

复制代码

跳转到最佳答案楼层

Twilight6

是 User-Agent 不是 User:Agent

1. import bs4
   
2. import re
   
3. import requests
   
4. 
   
5. header = {'User-Agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36'}
   
6. res = requests.get('https://movie.douban.com/top250',headers = header)
   
7. soup = bs4.BeautifulSoup(res.text,'html.parser')
   
8. namelist = soup.find_all('div',class_='hd')
   
9. for each in namelist:
   
10.     print(each.a.span.text)

复制代码

大地郡主

Twilight6 发表于 2020-7-27 23:04
是 User-Agent 不是 User:Agent

呃，低级错误谢谢您，我再认真些