[已解决]为什么我的url会报错

1073376322

response = urllib.request.urlopen('http://www.bilibili.com')
Traceback (most recent call last):
  File "<pyshell#1>", line 1, in <module>
    response = urllib.request.urlopen('http://www.bilibili.com')
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 222, in urlopen
    return opener.open(url, data, timeout)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 531, in open
    response = meth(req, response)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 563, in error
    result = self._call_chain(*args)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 503, in _call_chain
    result = func(*args)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 755, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 531, in open
    response = meth(req, response)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 563, in error
    result = self._call_chain(*args)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 503, in _call_chain
    result = func(*args)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 755, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 531, in open
    response = meth(req, response)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 569, in error
    return self._call_chain(*args)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 503, in _call_chain
    result = func(*args)
  File "C:\Users\king\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 649, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: Forbidden

最佳答案

月排行榜 / 总排行榜

facevoid

2019-9-17 16:56:38

你这样直接访问会被网站识别出来是用python脚本在访问网站，网站一般会发送403错误禁止你的访问。

你需要加上header来模拟浏览器的访问过程：

from urllib import request

req = request.Request('http://www.bilibili.com')
req.add_header('User-Agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:68.0) Gecko/20100101 Firefox/68.0')
response = request.urlopen(req)

跳转到最佳答案楼层

塔利班

header都没设置，bilibili随便让爬了么

wp231957

为啥就贴一句代码，难道就这句错了

1073376322

wp231957 发表于 2019-9-17 16:53
为啥就贴一句代码，难道就这句错了

对啊，之前就是import

1073376322

塔利班 发表于 2019-9-17 16:53
header都没设置，bilibili随便让爬了么

啥叫header

facevoid

你这样直接访问会被网站识别出来是用python脚本在访问网站，网站一般会发送403错误禁止你的访问。

你需要加上header来模拟浏览器的访问过程：

from urllib import request

req = request.Request('http://www.bilibili.com')
req.add_header('User-Agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:68.0) Gecko/20100101 Firefox/68.0')
response = request.urlopen(req)