[已解决]python爬虫request传入cookies不成功

fineconey

请教一个问题，

1. # -*- coding: utf-8 -*-
   
2. import re
   
3. import requests
   
4. sn=0
   
5. headers ={
   
6. "Accept":" text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8",
   
7. "Accept-Encoding": "gzip, deflate, br",
   
8. "Accept-Language": "zh-CN,zh;q=0.9",
   
9. "Cache-Control": "max-age=0",
   
10. "Connection":" keep-alive",
    
11. "Cookie": "tp=MGM0NzFFYTgwZWM3YjFjZDc3MTg5MmQ5MDIwZDIzNjFkMjdiMmQxNA%3D%3D",
    
12. "DNT": "1",
    
13. "Host": "tp.m-team.cc",
    
14. "Referer": "https://tp.m-team.cc/",
    
15. "Upgrade-Insecure-Requests": "1",
    
16. "User-Agent":" Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.25 Safari/537.36 Core/1.70.3704.400 QQBrowser/10.4.3588.400"
    
17. }
    
18. 
    
19. url='https://tp.m-team.cc/movie.php?inclbookmarked=0&incldead=1&spstate=0&page=1'
    
20. r=requests.get(url,headers=headers)
    
21. print(r)

复制代码

想爬取一个pt网站的标题，但是需要登陆才可以。网上查询，可以传入cookies给request.get。但是发现一个，老是出错。不知道原因在哪里。但是用同样的方法爬取另外一个网站就没问题。
求解决。感谢。






显示以下错误

1. "F:\【Mr.Zhang's python files】\venv\Scripts\python.exe" "F:/【Mr.Zhang's python files】/mteam.py"
   
2. Traceback (most recent call last):
   
3.   File "F:/【Mr.Zhang's python files】/mteam.py", line 20, in <module>
   
4.     r=requests.get(url,headers=headers)
   
5.   File "C:\Users\Mr.Zhang\AppData\Local\Programs\Python\Python37\lib\site-packages\requests\api.py", line 75, in get
   
6.     return request('get', url, params=params, **kwargs)
   
7.   File "C:\Users\Mr.Zhang\AppData\Local\Programs\Python\Python37\lib\site-packages\requests\api.py", line 60, in request
   
8.     return session.request(method=method, url=url, **kwargs)
   
9.   File "C:\Users\Mr.Zhang\AppData\Local\Programs\Python\Python37\lib\site-packages\requests\sessions.py", line 519, in request
   
10.     prep = self.prepare_request(req)
    
11.   File "C:\Users\Mr.Zhang\AppData\Local\Programs\Python\Python37\lib\site-packages\requests\sessions.py", line 462, in prepare_request
    
12.     hooks=merge_hooks(request.hooks, self.hooks),
    
13.   File "C:\Users\Mr.Zhang\AppData\Local\Programs\Python\Python37\lib\site-packages\requests\models.py", line 314, in prepare
    
14.     self.prepare_headers(headers)
    
15.   File "C:\Users\Mr.Zhang\AppData\Local\Programs\Python\Python37\lib\site-packages\requests\models.py", line 448, in prepare_headers
    
16.     check_header_validity(header)
    
17.   File "C:\Users\Mr.Zhang\AppData\Local\Programs\Python\Python37\lib\site-packages\requests\utils.py", line 942, in check_header_validity
    
18.     raise InvalidHeader("Invalid return character or leading space in header: %s" % name)
    
19. requests.exceptions.InvalidHeader: Invalid return character or leading space in header: User-Agent
    
20. 
    
21. 进程已结束,退出代码1
    

复制代码

最佳答案

月排行榜 / 总排行榜

Jery_wang09

2019-7-4 10:32:44

好多地方都多了空格
# -*- coding: utf-8 -*-
import re
import requests
sn=0
headers ={
"Accept":" text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8",
"Accept-Encoding": "gzip, deflate, br",
"Accept-Language": "zh-CN,zh;q=0.9",
"Cache-Control": "max-age=0",
"Connection":" keep-alive",
"Cookie": "tp=MGM0NzFFYTgwZWM3YjFjZDc3MTg5MmQ5MDIwZDIzNjFkMjdiMmQxNA%3D%3D",
"DNT": "1",
"Host": "tp.m-team.cc",
"Referer": "https://tp.m-team.cc/",
"Upgrade-Insecure-Requests": "1",
"User-Agent":" Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.25 Safari/537.36 Core/1.70.3704.400 QQBrowser/10.4.3588.400"
}

url='https://tp.m-team.cc/movie.php?inclbookmarked=0&incldead=1&spstate=0&page=1'
r=requests.get(url,headers=headers)
print(r)

跳转到最佳答案楼层

My_A

把User-Agent字符串开头的空格去掉

fineconey

My_A 发表于 2019-6-30 01:08
把User-Agent字符串开头的空格去掉

去掉了也不行哦。

Jery_wang09

好多地方都多了空格
# -*- coding: utf-8 -*-
import re
import requests
sn=0
headers ={
"Accept":" text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8",
"Accept-Encoding": "gzip, deflate, br",
"Accept-Language": "zh-CN,zh;q=0.9",
"Cache-Control": "max-age=0",
"Connection":" keep-alive",
"Cookie": "tp=MGM0NzFFYTgwZWM3YjFjZDc3MTg5MmQ5MDIwZDIzNjFkMjdiMmQxNA%3D%3D",
"DNT": "1",
"Host": "tp.m-team.cc",
"Referer": "https://tp.m-team.cc/",
"Upgrade-Insecure-Requests": "1",
"User-Agent":" Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.25 Safari/537.36 Core/1.70.3704.400 QQBrowser/10.4.3588.400"
}

url='https://tp.m-team.cc/movie.php?inclbookmarked=0&incldead=1&spstate=0&page=1'
r=requests.get(url,headers=headers)
print(r)

wp231957

有账号吗  有的话  用selenium