CrawlSpider爬图片的时候遇到了不完整url

狗宁

这是部分代码

1. class BizhiSpider(CrawlSpider):
   
2.     name = 'bizhi'
   
3.     # allowed_domains = ['www.xxxx.com']
   
4.     start_urls = ['http://www.netbian.com/weimei/']
   
5.     start_link = LinkExtractor(allow='index_\d+?.htm')
   
6.     detail_link = LinkExtractor(allow='desk.+?\.htm')
   
7.     link = []
   
8.     detail=[]
   
9.     for each in start_link:
   
10.         each = 'http://www.netbian.com/' + each
    
11.         link.append(each)
    
12.     for url in detail_link:
    
13.         url = 'http://www.netbian.com/' + url
    
14.         detail.append(url)
    
15.      #对页码url进行解析
    
16.     rules = (
    
17.         Rule(link, callback='parse_item', follow=False),
    
18.         Rule(detail,callback=detail_parse,follow=True)
    
19.     )
    
20.     #页码解析函数
    
21.     def parse_item(self, response):
    
22.         pass
    
23.         # li_list = response.xpath('//*[@id="main"]/div[2]/ul/li')
    
24.         # item = QuanzhanproItem()
    
25.         # for li in li_list:
    
26.         #     img_name = li.xpath('./a/@title').extract_first()
    
27.         #     item['img_name'] = img_name
    
28. 
    
29.     def detail_parse(self,response):
    
30.         src = response.xpath('//*[@id="main"]/div[2]/div/p/a/img/@src').extract_first()
    
31.         item = QuanzhanproItem()
    
32.         item['src'] = src
    
33.         yield item
    
34. 
    

复制代码

在用链接提取器后提取到了不完整的url，我以为可以迭代然后拼接，可是报错了，问一下有没有比较ok的解决办法？？

狗宁

解决了 ，自己想多了，这个LinkExtractor会自动解析当前主域名然后拼接，希望能帮到你们