鱼C论坛

 找回密码
 立即注册
查看: 613|回复: 9

爬取网站,但是网站把json每个引号前面都加上了\,用json.loads报错。如何破

[复制链接]
发表于 2018-8-9 16:15:34 | 显示全部楼层 |阅读模式

马上注册,结交更多好友,享用更多功能^_^

您需要 登录 才可以下载或查看,没有账号?立即注册

x
本帖最后由 小小小小的鱼丶 于 2018-8-9 16:16 编辑
{"count":6,"sub_images":[{"url":"http:\\/\\/p1.pstatp.com\\/origin\\/pgc-image\\/1533785526912d2a18e4ad6","width":690,"url_list":[{"url":"http:\\/\\/p1.pstatp.com\\/origin\\/pgc-image\\/1533785526912d2a18e4ad6"},{"url":"http:\\/\\/pb3.pstatp.com\\/origin\\/pgc-image\\/1533785526912d2a18e4ad6"},{"url":"http:\\/\\/pb9.pstatp.com\\/origin\\/pgc-image\\/1533785526912d2a18e4ad6"}],"uri":"origin\\/pgc-image\\/1533785526912d2a18e4ad6","height":1064},{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/15337855273617f8ee372d5","width":690,"url_list":[{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/15337855273617f8ee372d5"},{"url":"http:\\/\\/pb9.pstatp.com\\/origin\\/pgc-image\\/15337855273617f8ee372d5"},{"url":"http:\\/\\/pb1.pstatp.com\\/origin\\/pgc-image\\/15337855273617f8ee372d5"}],"uri":"origin\\/pgc-image\\/15337855273617f8ee372d5","height":1034},{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/15337855275850c84218425","width":690,"url_list":[{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/15337855275850c84218425"},{"url":"http:\\/\\/pb9.pstatp.com\\/origin\\/pgc-image\\/15337855275850c84218425"},{"url":"http:\\/\\/pb1.pstatp.com\\/origin\\/pgc-image\\/15337855275850c84218425"}],"uri":"origin\\/pgc-image\\/15337855275850c84218425","height":1035},{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/153378552784432b49af5c7","width":690,"url_list":[{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/153378552784432b49af5c7"},{"url":"http:\\/\\/pb9.pstatp.com\\/origin\\/pgc-image\\/153378552784432b49af5c7"},{"url":"http:\\/\\/pb1.pstatp.com\\/origin\\/pgc-image\\/153378552784432b49af5c7"}],"uri":"origin\\/pgc-image\\/153378552784432b49af5c7","height":1035},{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/1533785528582b5120f6d8e","width":690,"url_list":[{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/1533785528582b5120f6d8e"},{"url":"http:\\/\\/pb9.pstatp.com\\/origin\\/pgc-image\\/1533785528582b5120f6d8e"},{"url":"http:\\/\\/pb1.pstatp.com\\/origin\\/pgc-image\\/1533785528582b5120f6d8e"}],"uri":"origin\\/pgc-image\\/1533785528582b5120f6d8e","height":1227},{"url":"http:\\/\\/p9.pstatp.com\\/origin\\/pgc-image\\/1533785528961c8429ebf56","width":690,"url_list":[{"url":"http:\\/\\/p9.pstatp.com\\/origin\\/pgc-image\\/1533785528961c8429ebf56"},{"url":"http:\\/\\/pb1.pstatp.com\\/origin\\/pgc-image\\/1533785528961c8429ebf56"},{"url":"http:\\/\\/pb3.pstatp.com\\/origin\\/pgc-image\\/1533785528961c8429ebf56"}],"uri":"origin\\/pgc-image\\/1533785528961c8429ebf56","height":1042}],"max_img_width":690,"labels":["\\u65f6\\u88c5\\u642d\\u914d"],"sub_abstracts":["\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01"," "," "," "," "," "],"sub_titles":["\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01","\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01","\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01","\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01","\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01","\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01"]}
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复

使用道具 举报

发表于 2018-8-9 16:20:31 | 显示全部楼层
xxx.split('\\','')
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

 楼主| 发表于 2018-8-9 16:23:16 | 显示全部楼层
本帖最后由 小小小小的鱼丶 于 2018-8-9 16:24 编辑

OU{W8]IYW(M)E3YJ9X67D@I.png 是这样的。。贴代码代码给自动忽略了。。不知道为啥。。
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

发表于 2018-8-9 16:25:37 | 显示全部楼层
或者这样:
xxx.split('\\\"','"')

点评

注意,后面的字符串是两个单引号夹着双引号  发表于 2018-8-9 16:26
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

 楼主| 发表于 2018-8-9 17:59:38 | 显示全部楼层
无符号整形 发表于 2018-8-9 16:25
或者这样:
xxx.split('\\\"','"')

我用的是re.sub来替换掉。但是很奇怪的是
import  re
这个能替换掉
s = '{"count":6,"sub_images":[{"url":"http:\\/\\/p1.pstatp.com\\/origin\\/pgc-image\\/1533785526912d2a18e4ad6","width":690,"url_list":[{"url":"http:\\/\\/p1.pstatp.com\\/origin\\/pgc-image\\/1533785526912d2a18e4ad6"},{"url":"http:\\/\\/pb3.pstatp.com\\/origin\\/pgc-image\\/1533785526912d2a18e4ad6"},{"url":"http:\\/\\/pb9.pstatp.com\\/origin\\/pgc-image\\/1533785526912d2a18e4ad6"}],"uri":"origin\\/pgc-image\\/1533785526912d2a18e4ad6","height":1064},{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/15337855273617f8ee372d5","width":690,"url_list":[{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/15337855273617f8ee372d5"},{"url":"http:\\/\\/pb9.pstatp.com\\/origin\\/pgc-image\\/15337855273617f8ee372d5"},{"url":"http:\\/\\/pb1.pstatp.com\\/origin\\/pgc-image\\/15337855273617f8ee372d5"}],"uri":"origin\\/pgc-image\\/15337855273617f8ee372d5","height":1034},{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/15337855275850c84218425","width":690,"url_list":[{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/15337855275850c84218425"},{"url":"http:\\/\\/pb9.pstatp.com\\/origin\\/pgc-image\\/15337855275850c84218425"},{"url":"http:\\/\\/pb1.pstatp.com\\/origin\\/pgc-image\\/15337855275850c84218425"}],"uri":"origin\\/pgc-image\\/15337855275850c84218425","height":1035},{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/153378552784432b49af5c7","width":690,"url_list":[{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/153378552784432b49af5c7"},{"url":"http:\\/\\/pb9.pstatp.com\\/origin\\/pgc-image\\/153378552784432b49af5c7"},{"url":"http:\\/\\/pb1.pstatp.com\\/origin\\/pgc-image\\/153378552784432b49af5c7"}],"uri":"origin\\/pgc-image\\/153378552784432b49af5c7","height":1035},{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/1533785528582b5120f6d8e","width":690,"url_list":[{"url":"http:\\/\\/p3.pstatp.com\\/origin\\/pgc-image\\/1533785528582b5120f6d8e"},{"url":"http:\\/\\/pb9.pstatp.com\\/origin\\/pgc-image\\/1533785528582b5120f6d8e"},{"url":"http:\\/\\/pb1.pstatp.com\\/origin\\/pgc-image\\/1533785528582b5120f6d8e"}],"uri":"origin\\/pgc-image\\/1533785528582b5120f6d8e","height":1227},{"url":"http:\\/\\/p9.pstatp.com\\/origin\\/pgc-image\\/1533785528961c8429ebf56","width":690,"url_list":[{"url":"http:\\/\\/p9.pstatp.com\\/origin\\/pgc-image\\/1533785528961c8429ebf56"},{"url":"http:\\/\\/pb1.pstatp.com\\/origin\\/pgc-image\\/1533785528961c8429ebf56"},{"url":"http:\\/\\/pb3.pstatp.com\\/origin\\/pgc-image\\/1533785528961c8429ebf56"}],"uri":"origin\\/pgc-image\\/1533785528961c8429ebf56","height":1042}],"max_img_width":690,"labels":["\\u65f6\\u88c5\\u642d\\u914d"],"sub_abstracts":["\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01"," "," "," "," "," "],"sub_titles":["\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01","\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01","\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01","\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01","\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01","\\u8857\\u62cd\\u676d\\u5dde\\uff1a\\u6210\\u719f\\u5973\\u4eba\\u5473\\u7684\\u65f6\\u5c1a\\u7a7f\\u642d\\u53c2\\u8003\\uff0c\\u8ba9\\u4f60\\u6210\\u4e3a\\u805a\\u4f17\\u7684\\u7126\\u70b9\\uff01"]}'
s= re.sub(r'"','"',s)
print(s)
这个不能把\“替换成“
 result_text = re.search('gallery: JSON.parse\("(.*)"\)',html).group(1)
    result = re.sub(r'"','"',str(result_text))
    print(result)
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

 楼主| 发表于 2018-8-9 18:02:08 | 显示全部楼层
无符号整形 发表于 2018-8-9 16:25
或者这样:
xxx.split('\\\"','"')

改成这样才能替换掉,你看一下我上面给你发的图,直接贴代码会\”会变成 ”
 result = re.sub(r'\"','"',str(result_text))
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

发表于 2018-8-9 18:15:28 | 显示全部楼层
小小小小的鱼丶 发表于 2018-8-9 18:02
改成这样才能替换掉,你看一下我上面给你发的图,直接贴代码会\”会变成 ”

看了,我那样不行吗?
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

 楼主| 发表于 2018-8-9 18:33:55 | 显示全部楼层
无符号整形 发表于 2018-8-9 18:15
看了,我那样不行吗?

你那样好像不行。。我视频才看到一半。。。然后。。。然后。。。。然后我IP好像被今日头条封了。。。。。。。用代理好像也没用。。。
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

发表于 2018-8-9 18:35:47 | 显示全部楼层
小小小小的鱼丶 发表于 2018-8-9 18:33
你那样好像不行。。我视频才看到一半。。。然后。。。然后。。。。然后我IP好像被今日头条封了。。。。。 ...

好吧,你明天试试吧……
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

小黑屋|手机版|Archiver|鱼C工作室 ( 粤ICP备18085999号-1 | 粤公网安备 44051102000585号)

GMT+8, 2024-10-6 06:40

Powered by Discuz! X3.4

© 2001-2023 Discuz! Team.

快速回复 返回顶部 返回列表