http error 401 求助
本帖最后由 三一王 于 2021-1-9 20:13 编辑目标网页的request header如上图所示。
def url_open(url):
req = urllib.request.Request(url)
req.add_header('user-agent',
'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.122 Safari/537.36')
req.add_header('cookie',
'''sajssdk_2015_cross_new_user=1; sensorsdata2015jssdkcross=%7B%22distinct_id%22%3A%22176e5ddd74c256-0ac4fc023ec3e8-c791039-2073600-176e5ddd74d2a3%22%2C%22%24device_id%22%3A%22176e5ddd74c256-0ac4fc023ec3e8-c791039-2073600-176e5ddd74d2a3%22%2C%22props%22%3A%7B%22%24latest_referrer%22%3A%22%22%2C%22%24latest_referrer_host%22%3A%22%22%2C%22%24latest_traffic_source_type%22%3A%22%E7%9B%B4%E6%8E%A5%E6%B5%81%E9%87%8F%22%2C%22%24latest_search_keyword%22%3A%22%E6%9C%AA%E5%8F%96%E5%88%B0%E5%80%BC_%E7%9B%B4%E6%8E%A5%E6%89%93%E5%BC%80%22%7D%7D; api_server_id=1oxYuM0c; sensorsdata-token=5DKLZX4BEiDNPYHUzt0R0yIzmNTI9S7uNWEGR0JOi49aZYMpUtbOiP2tdKPm59k3V8V8MKthQDMxRyyziAHx93ftmLRzUkGeQbhBuQlD65VhK972HiBF7GRSqznPdWOj; sajssdk_2015_new_user_sensors-web=1; sa_jssdk_2015_sensors-web=%7B%22distinct_id%22%3A%22vandream%3A60%22%2C%22props%22%3A%7B%22customer_id%22%3A%22vandream%22%2C%22project_name%22%3A%22production%22%2C%22username%22%3A%22zhangyu%40vandream.com%22%2C%22isDemo%22%3Afalse%2C%22version1%22%3A%221.17%22%2C%22version2%22%3A%221.17.5036%22%7D%7D; csrftoken=oC7QFB15wR6THxWm84c8fMcLaYfVIXfc''')
因为网站需要登录，所以我登录后获取了cookie并添加到header中。但是运行代码后，提示urllib.error.HTTPError: HTTP Error 401: Unauthorized。
求助鱼友们~~~~ cookie应该是会变的，或者还有别的登录校验 2269099035 发表于 2021-1-9 20:15
cookie应该是会变的，或者还有别的登录校验
我账号登录后，在不同页面看过好几次了，cookie都是相同的 反爬虫验证, 不只是验证cookie, 包括很多的, 比如header中的: origin, referer.还需要注意的是Content-type
页:
[1]