[已解决]爬虫代码为什么总是显示urllib.error.URLError: <urlopen error no host given>

十四说四十

import re
import urllib.request
import os


def open_url(rul):

    req = urllib.request.Request(url)
    req.add_header('User-Agent','Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36')

    page = urllib.request.urlopen(req)
    html = page.read().decode('utf-8')

    return html


def get_url(html):

    key = re.compile(r'[src="]([^"]+\.jpg)"')
    url_addrs = key.findall(html)

    return url_addrs


def save_url(url_addrs):

    for each in url_addrs:
        filename = each.split('/')[-1]
        urllib.request.urlretrieve(each,filename,None)


def download_url(url,folder = '手写加油接力'):
   
    os.mkdir(folder)
    os.chdir(folder)

    html = open_url(url)
    url_addrs = get_url(html)
    save_url(url_addrs)


if __name__ == '__main__':

    url = 'http://tieba.baidu.com/p/6474518269?red_tag=i2511495534'

    download_url(url)

最佳答案

月排行榜 / 总排行榜

suchocolate

2020-2-15 10:37:48

函数open_url()里的参数写错了，写成了rul

跳转到最佳答案楼层

zltzlt

应该是 url = 'https://tieba.baidu.com/p/6474518269?red_tag=i2511495534'

十四说四十

zltzlt 发表于 2020-2-6 12:49
应该是 url = 'https://tieba.baidu.com/p/6474518269?red_tag=i2511495534'

好哒，谢谢大佬

十四说四十

zltzlt 发表于 2020-2-6 12:49
应该是 url = 'https://tieba.baidu.com/p/6474518269?red_tag=i2511495534'

改完还是不行啊。。。

哈喇子淌一手

chrome->baidu->F12->network->copy->copy as curl,再下载个postman,自己慢慢玩,postman可以直接转化为code,

suchocolate

函数open_url()里的参数写错了，写成了rul

孙小兑EVA

楼主有解决吗？