[已解决]关于抓取某商品网站图头的问题

ddtufoer

win7 64位系统　spython3.5
抓取韩国某商品网站图片，代码如下

1. import re
   
2. from selenium import webdriver
   
3. 
   
4. #抓取用Chrome渲染后的网页图片
   
5. a=webdriver.Chrome()
   
6. a.get('http://www.funnymade.com/shop/goods/goods_view.php?goodsno=143&category=')
   
7. c=a.page_source
   
8. 
   
9. re1='<img[^>]*src="([^"]*)"'
   
10. imglist=re.findall(re1,c)
    
11. 
    
12. print(imglist)

复制代码

因为该网页中有JS渲染内容所以用了selenium模拟Chrome浏览器来加载，但是加载后的内容还是不全，且有大量相对地址。请问有没有什么方法可以得到以上网址五个600*600的图头?
以上代码运行后的结果如下:

1. ['/shop/data/skin/no88/img/main/close.gif', '/shop/data/skin/no88/img/main/btn_mypage_go.gif', '/shop/data/wizdesign/up.png', '/shop/data//wizdesign/btn_down.png', '/shop/data/wizdesign/list_icon.png', '/shop/data/wizdesign/list_icon2.png', '/shop/data/wizdesign/add_icon1.png', '/shop/data/wizdesign/joinpoint.png', '/shop/data/wizdesign/add_icon1.png', '/shop/data/wizdesign/logo.png', '/shop/data/skin/no88/img/banner/sns_f.png', '/shop/data/skin/no88/img/banner/sns_k.png', '/shop/data/skin/no88/img/banner/sns_i.png', '../data/goods/1465437265560m0.jpg', '/shop/data/skin/no88/img/common/btn_zoom.gif', '../data/goods/t/1465437265560m0.jpg', '../data/goods/t/1465437265299m1.jpg', '../data/goods/t/1465437265838m2.jpg', '../data/goods/t/1465437265522m3.jpg', '../data/goods/t/1465437265910m4.jpg', '/shop/data/skin/no88/img/common/btn_plus.gif', '/shop/data/skin/no88/img/common/btn_minus.gif', '../data/skin/no88/img/icon/good_icon_new.gif', '/shop/data/skin/no88/img/common/btn_multioption_br.gif', '/shop/admin/img/natescrab_btn.gif', '../data/skin/no88/img/sns/icon_twitter.png', '../data/skin/no88/img/sns/icon_facebook.png', '../data/skin/no88/img/sns/icon_url.png', 'https://paycoscdn.toastoven.net/payco/bill/checkout/img/v2/ico_arr_bx.gif', 'http://funnymade.godohosting.com/image/pouch/clearpouch/clearpouch-m.jpg', '../data/goods/1467268630178s0.jpg', '../data/skin/no88/img/icon/good_icon_new.gif', '../data/goods/1333007167_s_0.jpg', '../data/goods/1457505743522s0.jpg', '../data/skin/no88/img/icon/good_icon_new.gif', '../data/skin/no88/img/icon/good_icon_best.gif', '../data/goods/1333007143_s_0.jpg', '../data/goods/139143631622s0.jpg', '/shop/data/skin/no88/img/common/bar_detail_07.gif', 'http://funnymade.godohosting.com/toktok.png', '/shop/data/wizdesign/tit_today_view_h21.gif', '/shop/data/skin/no88/img/common/sky_btn_up.gif', '/shop/data/skin/no88/img/common/sky_btn_down.gif', '/shop/data/wizdesign/go_top_h18.gif']

复制代码

最佳答案

月排行榜 / 总排行榜

SixPy

2016-9-7 09:36:27

棒子写的网页不太规范~

1. import re
   
2. import requests as req
   
3. 
   
4. url = 'http://www.funnymade.com/shop/goods/goods_view.php?goodsno=143&category='
   
5. url_shop = 'http://www.funnymade.com/shop'
   
6. html = req.get(url).text
   
7. 
   
8. ptn = re.compile(r"<img[^>]*src='([^']*)'[^>]*?class=hand")
   
9. imglist = [src.replace('..', url_shop)\
   
10.               .replace('/t/', '/')
    
11.            for src in ptn.findall(html)]         
    
12. 
    
13. print(imglist)
    

复制代码

结果：

1. ['http://www.funnymade.com/shop/data/goods/1465437265560m0.jpg',
   
2. 'http://www.funnymade.com/shop/data/goods/1465437265299m1.jpg',
   
3. 'http://www.funnymade.com/shop/data/goods/1465437265838m2.jpg',
   
4. 'http://www.funnymade.com/shop/data/goods/1465437265522m3.jpg',
   
5. 'http://www.funnymade.com/shop/data/goods/1465437265910m4.jpg']
   

复制代码

跳转到最佳答案楼层

SixPy

棒子写的网页不太规范~

1. import re
   
2. import requests as req
   
3. 
   
4. url = 'http://www.funnymade.com/shop/goods/goods_view.php?goodsno=143&category='
   
5. url_shop = 'http://www.funnymade.com/shop'
   
6. html = req.get(url).text
   
7. 
   
8. ptn = re.compile(r"<img[^>]*src='([^']*)'[^>]*?class=hand")
   
9. imglist = [src.replace('..', url_shop)\
   
10.               .replace('/t/', '/')
    
11.            for src in ptn.findall(html)]         
    
12. 
    
13. print(imglist)
    

复制代码

结果：

1. ['http://www.funnymade.com/shop/data/goods/1465437265560m0.jpg',
   
2. 'http://www.funnymade.com/shop/data/goods/1465437265299m1.jpg',
   
3. 'http://www.funnymade.com/shop/data/goods/1465437265838m2.jpg',
   
4. 'http://www.funnymade.com/shop/data/goods/1465437265522m3.jpg',
   
5. 'http://www.funnymade.com/shop/data/goods/1465437265910m4.jpg']
   

复制代码

ddtufoer

SixPy 发表于 2016-9-7 09:36
棒子写的网页不太规范~

结果：

我还有个问题，那就是 为啥你这么牛泥？为啥这么牛泥？为啥泥？