设为首页收藏本站
切换到窄版

鱼C论坛

 找回密码
 立即注册
鱼C论坛»论坛 › 编程语言专区 › Python交流 › 爬百度贴吧图片的时候urlopen返回的对象用正则或者BS4都 ...
返回列表 发新帖
查看: 2184|回复: 2

爬百度贴吧图片的时候urlopen返回的对象用正则或者BS4都匹配不到BDE_image类里的图

[复制链接]
fqshct1994
发表于 2020-2-4 17:33:40 | 显示全部楼层 |阅读模式

马上注册，结交更多好友，享用更多功能^_^

您需要 登录 才可以下载或查看，没有账号？立即注册

x
代码如下

import urllib.request
import random
import re
from bs4 import BeautifulSoup as bs
def open_url(url):
    req = urllib.request.Request(url)
    req.add_header('user-agent','Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Mobile Safari/537.36')
    response = urllib.request.urlopen(req)
    html = response.read().decode('utf-8')
# html = bs(html,'html.parser')
    return html

url = 'https://tieba.baidu.com/p/6234876139'
html = open_url(url)
r = '<img class="BDE_Image"'
a = re.findall(r,html)

print(a)

打印a的时候是空数组，但是网页踩点的时候里面确实是有那个类的，我的正则没写全，想表达的就是连前面一丁点都匹配不到心好累
请大家赐教
小甲鱼最新课程 -> https://ilovefishc.com
回复

使用道具 举报

ll104567
发表于 2020-2-5 09:11:22 | 显示全部楼层
送你一个  re.findall('<img class="BDE_[^>]*src="(.*)"\s>',a.text)

另外我看了你说的那个，并没有BDE_image
nuo~
  1. In [27]: b.find_all('img')
  2. Out[27]:
  3. [<img class="card_head_img" src="https://gss3.bdstatic.com/84oSdTum2Q5BphGlnYG/timg?wapp&amp;quality=80&amp;size=b150_150&amp;subsize=20480&amp;cut_x=0&amp;cut_w=0&amp;cut_y=0&amp;cut_h=0&amp;sec=1369815402&amp;srctrace&amp;di=9b16e2a95a19e9507284af1b0770ca7a&amp;wh_rate=null&amp;src=http%3A%2F%2Fimgsrc.baidu.com%2Fforum%2Fpic%2Fitem%2Fe1fe9925bc315c606d9c6be280b1cb13495477b5.jpg"/>,
  4. <img class="" src="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.d1885859.her7s3W2NyvV-ttcXZlsoQ?t=1546357002" username="金弹子花苑"/>,
  5. <img changedsize="true" class="BDE_Image" height="746" size="744302" src="https://imgsa.baidu.com/forum/w%3D580/sign=24d60cd9da2a283443a636036bb4c92e/7d0cbfeef01f3a29697ac90a9725bc315d607c18.jpg" width="560"/>,
  6. <img changedsize="true" class="BDE_Image" height="746" size="583480" src="https://imgsa.baidu.com/forum/w%3D580/sign=509991fa75ec54e741ec1a16893a9bfd/ca9fb43df8dcd100cb07e4e57c8b4710b8122f37.jpg" width="560"/>,
  7. <img changedsize="true" class="BDE_Image" height="420" size="324464" src="https://imgsa.baidu.com/forum/w%3D580/sign=0bf2bd1afe1f3a295ac8d5c6a927bce3/5c36f6c451da81cbbe7d9f095c66d01608243137.jpg" width="560"/>,
  8. <img changedsize="true" class="BDE_Image" height="746" size="618444" src="https://imgsa.baidu.com/forum/w%3D580/sign=396cf83ca986c91708035231f93f70c6/4241c0c4b74543a92e80e60810178a82b8011437.jpg" width="560"/>,
  9. <img changedsize="true" class="BDE_Image" height="420" size="283637" src="https://imgsa.baidu.com/forum/w%3D580/sign=43328d36731ed21b79c92eed9d6cddae/76598a8b87d6277f5a892efc26381f30e824fc30.jpg" width="560"/>,
  10. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  11. <img class="" src="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.c8997a1f.ktS66qIzKqZ8l05FV8ZiXA?t=1525816251" username="平原下山桩"/>,
  12. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  13. <img class="" src="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.b631a258.Gs0vCJ3fhZKGxHZDx-ueaw?t=1580734414" username="户口你好"/>,
  14. <img class="nicknameEmoji" src="//tb1.bdstatic.com/tb/cms/nickemoji/1-23.png" style="width:13px;height:13px"/>,
  15. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  16. <img class="" data-tb-lazyload="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.30a6cb5e.nhU1NCOmphCX94RueiD-XQ?t=1573562957" src="//tb2.bdstatic.com/tb/static-pb/img/head_80.jpg" username="扯蛋的弹"/>,
  17. <img class="nicknameEmoji" src="//tb1.bdstatic.com/tb/cms/nickemoji/4-20.png" style="width:13px;height:13px"/>,
  18. <img changedsize="false" class="BDE_Smiley" height="30" src="https://gsp0.baidu.com/5aAHeD3nKhI2p27j8IqW0jdnxx1xbK/tb/editor/images/client/image_emoticon2.png" width="30"/>,
  19. <img changedsize="false" class="BDE_Smiley" height="30" src="https://gsp0.baidu.com/5aAHeD3nKhI2p27j8IqW0jdnxx1xbK/tb/editor/images/client/image_emoticon2.png" width="30"/>,
  20. <img changedsize="false" class="BDE_Smiley" height="30" src="https://gsp0.baidu.com/5aAHeD3nKhI2p27j8IqW0jdnxx1xbK/tb/editor/images/client/image_emoticon2.png" width="30"/>,
  21. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  22. <img class="" data-tb-lazyload="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.77461af3.-Moj2wCUKnFKDtC5_v0EDw?t=1546241635" src="//tb2.bdstatic.com/tb/static-pb/img/head_80.jpg" username="重新再来384"/>,
  23. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  24. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  25. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  26. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  27. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  28. <img class="" data-tb-lazyload="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.34a5feee.AILsP-lakUPy9uGoYzYVbg?t=1428907826" src="//tb2.bdstatic.com/tb/static-pb/img/head_80.jpg" username="鬼影ol"/>,
  29. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  30. <img class="" data-tb-lazyload="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.77461af3.-Moj2wCUKnFKDtC5_v0EDw?t=1546241635" src="//tb2.bdstatic.com/tb/static-pb/img/head_80.jpg" username="重新再来384"/>,
  31. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  32. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  33. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  34. <img alt="" src="//tb1.bdstatic.com/tb/cms/PC%E7%AB%AF%E5%BA%95%E9%83%A8%E9%80%9A%E6%A0%8F%E5%BC%B9%E5%B1%821000x120.png"/>,
  35. <img alt="" class="close" src="//tb2.bdstatic.com/tb/static-spage/widget/fixed_bar/images/icon_close_b98955a.png"/>,
  36. <img src=""/>]
复制代码
小甲鱼最新课程 -> https://ilovefishc.com
回复 支持 反对

使用道具 举报

ll104567
发表于 2020-2-5 09:13:00 | 显示全部楼层
送你一个 re.findall('<img class="BDE_[^>]*src="(.*)"\s>',a.text)

另外，仔细看了一下所有的img标签
并没有你写的那个

  1. In [27]: b.find_all('img')
  2. Out[27]:
  3. [<img class="card_head_img" src="https://gss3.bdstatic.com/84oSdTum2Q5BphGlnYG/timg?wapp&amp;quality=80&amp;size=b150_150&amp;subsize=20480&amp;cut_x=0&amp;cut_w=0&amp;cut_y=0&amp;cut_h=0&amp;sec=1369815402&amp;srctrace&amp;di=9b16e2a95a19e9507284af1b0770ca7a&amp;wh_rate=null&amp;src=http%3A%2F%2Fimgsrc.baidu.com%2Fforum%2Fpic%2Fitem%2Fe1fe9925bc315c606d9c6be280b1cb13495477b5.jpg"/>,
  4. <img class="" src="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.d1885859.her7s3W2NyvV-ttcXZlsoQ?t=1546357002" username="金弹子花苑"/>,
  5. <img changedsize="true" class="BDE_Image" height="746" size="744302" src="https://imgsa.baidu.com/forum/w%3D580/sign=24d60cd9da2a283443a636036bb4c92e/7d0cbfeef01f3a29697ac90a9725bc315d607c18.jpg" width="560"/>,
  6. <img changedsize="true" class="BDE_Image" height="746" size="583480" src="https://imgsa.baidu.com/forum/w%3D580/sign=509991fa75ec54e741ec1a16893a9bfd/ca9fb43df8dcd100cb07e4e57c8b4710b8122f37.jpg" width="560"/>,
  7. <img changedsize="true" class="BDE_Image" height="420" size="324464" src="https://imgsa.baidu.com/forum/w%3D580/sign=0bf2bd1afe1f3a295ac8d5c6a927bce3/5c36f6c451da81cbbe7d9f095c66d01608243137.jpg" width="560"/>,
  8. <img changedsize="true" class="BDE_Image" height="746" size="618444" src="https://imgsa.baidu.com/forum/w%3D580/sign=396cf83ca986c91708035231f93f70c6/4241c0c4b74543a92e80e60810178a82b8011437.jpg" width="560"/>,
  9. <img changedsize="true" class="BDE_Image" height="420" size="283637" src="https://imgsa.baidu.com/forum/w%3D580/sign=43328d36731ed21b79c92eed9d6cddae/76598a8b87d6277f5a892efc26381f30e824fc30.jpg" width="560"/>,
  10. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  11. <img class="" src="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.c8997a1f.ktS66qIzKqZ8l05FV8ZiXA?t=1525816251" username="平原下山桩"/>,
  12. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  13. <img class="" src="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.b631a258.Gs0vCJ3fhZKGxHZDx-ueaw?t=1580734414" username="户口你好"/>,
  14. <img class="nicknameEmoji" src="//tb1.bdstatic.com/tb/cms/nickemoji/1-23.png" style="width:13px;height:13px"/>,
  15. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  16. <img class="" data-tb-lazyload="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.30a6cb5e.nhU1NCOmphCX94RueiD-XQ?t=1573562957" src="//tb2.bdstatic.com/tb/static-pb/img/head_80.jpg" username="扯蛋的弹"/>,
  17. <img class="nicknameEmoji" src="//tb1.bdstatic.com/tb/cms/nickemoji/4-20.png" style="width:13px;height:13px"/>,
  18. <img changedsize="false" class="BDE_Smiley" height="30" src="https://gsp0.baidu.com/5aAHeD3nKhI2p27j8IqW0jdnxx1xbK/tb/editor/images/client/image_emoticon2.png" width="30"/>,
  19. <img changedsize="false" class="BDE_Smiley" height="30" src="https://gsp0.baidu.com/5aAHeD3nKhI2p27j8IqW0jdnxx1xbK/tb/editor/images/client/image_emoticon2.png" width="30"/>,
  20. <img changedsize="false" class="BDE_Smiley" height="30" src="https://gsp0.baidu.com/5aAHeD3nKhI2p27j8IqW0jdnxx1xbK/tb/editor/images/client/image_emoticon2.png" width="30"/>,
  21. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  22. <img class="" data-tb-lazyload="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.77461af3.-Moj2wCUKnFKDtC5_v0EDw?t=1546241635" src="//tb2.bdstatic.com/tb/static-pb/img/head_80.jpg" username="重新再来384"/>,
  23. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  24. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  25. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  26. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  27. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  28. <img class="" data-tb-lazyload="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.34a5feee.AILsP-lakUPy9uGoYzYVbg?t=1428907826" src="//tb2.bdstatic.com/tb/static-pb/img/head_80.jpg" username="鬼影ol"/>,
  29. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  30. <img class="" data-tb-lazyload="https://gss0.bdstatic.com/6LZ1dD3d1sgCo2Kml5_Y_D3/sys/portrait/item/tb.1.77461af3.-Moj2wCUKnFKDtC5_v0EDw?t=1546241635" src="//tb2.bdstatic.com/tb/static-pb/img/head_80.jpg" username="重新再来384"/>,
  31. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  32. <img class="BDE_Smiley" height="30" pic_type="1" src="https://tb2.bdstatic.com/tb/editor/images/face/i_f13.png?t=20140803" width="30"/>,
  33. <img class="icon-jubao" src="//tb2.bdstatic.com/tb/static-pb/img/jubao_button_5f60185.png"/>,
  34. <img alt="" src="//tb1.bdstatic.com/tb/cms/PC%E7%AB%AF%E5%BA%95%E9%83%A8%E9%80%9A%E6%A0%8F%E5%BC%B9%E5%B1%821000x120.png"/>,
  35. <img alt="" class="close" src="//tb2.bdstatic.com/tb/static-spage/widget/fixed_bar/images/icon_close_b98955a.png"/>,
  36. <img src=""/>]
复制代码
小甲鱼最新课程 -> https://ilovefishc.com
回复 支持 反对

使用道具 举报

返回列表 发新帖
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

小黑屋|手机版|Archiver|鱼C工作室 ( 粤ICP备18085999号-1 | 粤公网安备 44051102000585号)

GMT+8, 2025-12-18 21:29

Powered by Discuz! X3.4

© 2001-2023 Discuz! Team.

快速回复 返回顶部 返回列表