[已解决]requests请求问题

wzdyjn

import requests
import ssl

ssl._create_default_https_context = ssl._create_unverified_context

fenlei_url="https://movie.douban.com/j/search_tags?type=tv&source="
response =requests.get(fenlei_url)
rel =response.content.decode()
print(rel )

没有打印结果 不知道为什么？  去掉ssl验证又报错  郁闷  这个网址直接在浏览器中是有结果的  那个大神榜我看看

最佳答案

月排行榜 / 总排行榜

Twilight6

2020-7-13 15:11:51

加个 headers 参数就好：

import requests
import ssl

ssl._create_default_https_context = ssl._create_unverified_context

fenlei_url="https://movie.douban.com/j/search_tags?type=tv&source="
headers = {
    'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36'
}
response =requests.get(fenlei_url,headers=headers)
rel =response.content.decode()
print(rel)

输出结果：

{"tags":["热门","美剧","英剧","韩剧","日剧","国产剧","港剧","日本动画","综艺","纪录片"]}

跳转到最佳答案楼层

Twilight6

加个 headers 参数就好：

import requests
import ssl

ssl._create_default_https_context = ssl._create_unverified_context

fenlei_url="https://movie.douban.com/j/search_tags?type=tv&source="
headers = {
    'User-Agent':'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36'
}
response =requests.get(fenlei_url,headers=headers)
rel =response.content.decode()
print(rel)

输出结果：

{"tags":["热门","美剧","英剧","韩剧","日剧","国产剧","港剧","日本动画","综艺","纪录片"]}

青出于蓝

import requests
cookie={"Cookie":"""bid=mNQ7A7viJzI; douban-fav-remind=1; __gads=ID=4b7e04ab147c12ab:T=1591421016:S=ALNI_MY_zPkvb5MuCioC42Ca0KhJUgyE5w; __utma=30149280.116605.1591421020.1592541189.1592731495.3; __utmz=30149280.1592541189.2.2.utmcsr=baidu|utmccn=(organic)|utmcmd=organic; _pk_ref.100001.4cf6=%5B%22%22%2C%22%22%2C1592731495%2C%22https%3A%2F%2Fwww.baidu.com%2Flink%3Furl%3DSVTZxJFNs0ZG-oePWrjV7189CAPCK0k76H35o4qQdQmKyNuqU3_N3jPsGAGCpBZo%26wd%3D%26eqid%3D8158995500000a15000000025eec3ffe%22%5D; _pk_id.1
        00001.4cf6=371d7c14bd1cf098.1592541189.2.1592731495.15925412
        15.; __yadk_uid=uNUP8kIVFu9QtVYEPvOlA7KXvZQvZb3v; __utma=2236
        95111.1353623826.1592541189.1592541189.1592731496.2; __utmz=2
        23695111.1592541189.1.1.utmcsr=baidu|utmccn=(organic)|utmcmd=
        organic; ll="118220"; _vwo_uuid_v2=D8BB91EF5285B2E6D599A2D7BE
        04BEAED|caf2d36e4b3a50344438a00d8947acae"""}
headers={"User-Agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Firefox/78.0"}
fenlei_url="https://movie.douban.com/j/search_tags?type=tv&source="
response=requests.get(fenlei_url,cookies=cookie,headers=headers).text
print(response)

结果：

{"tags":["热门","美剧","英剧","韩剧","日剧","国产剧","港剧","日本动画","综艺","纪录片"]}

青出于蓝

ssl不需要啦，加个user-agent就好
还给加了个cookie，有了cookie，就等于登录进去了

小甲鱼的铁粉

还是爬虫有趣

wzdyjn

谢谢 亲们

wzdyjn

青出于蓝 发表于 2020-7-13 15:14
结果：

cookie 还可以这样写   三引号    学到了