[已解决]关于爬取网易云音乐评论的错误

cyff · 发表于 2020-7-26 01:03:42

马上注册，结交更多好友，享用更多功能^_^

您需要登录才可以下载或查看，没有账号？立即注册

x

相对课程中的函数，我改用了普通形式，但总会显示line35 KeyError：’hotComments‘，不论是’hotComments‘还是其他的，就是找不到。是哪里出错了吗
有大神帮帮忙嘛！

# -*- coding: utf-8 -*-
"""
Created on Sun Jul 26 00:18:36 2020
@author: Chang YF
"""
import requests
import json
headers = {'user-agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.98 Safari/537.36',
'referer': 'http://music.163.com/'}
params = '3a1OtDUiNmbCVaP1B5CPYSeyY/wDsYmmJwYd2jd3aCYZeUxW1WFFrS0XeT4MZOVXl04cibj3INebigj8HJZ51ZjXarsRz92q1IGzamJtEtEsyHs9e611kL8S/bngl8HQWQMj6e3BT1t412zB0YWZ9QzbH0hHiTienBvLVm4hrH63aTjpBu5BCaxYQcM23QuwRvFC0sQyM5764/zw7gQEKz3zHhg+BH5rCfHVjnK+nc4DwiiEnRTXZ1S4LTLt9xpC8g9MQ2yXWhDEVQ0U4xxuPQ=='
encSecKey = 'b5295ea54521dd92971c8d7ec485ae485cd46e6ad78755856d559a497e82a697764d1659229c31c55a633bbc02f775a24e4df9b8b0019abc119979ffaadfbed6892fcab1e43155acc643e660f98dc67d86c89aaa5be8dbd9d3f4bba62ad25b1ab2342cc66dd09e40f26e23647d0e01c348511332ad6c7e33da504b0f8a4b4f00'
data = {'params':params,'encSecKey':encSecKey}
url = 'https://music.163.com/#/song?id=4466775'
name_id =url.split('=')[1]
target = 'https://music.163.com/weapi/comment/resource/comments/get?csrf_token='
res = requests.post(target, headers=headers, data=data)
with open('res.txt','w',encoding='utf-8') as file:
file.write(res.text)
comments_json = json.loads(res.text)
print(comments_json)
hot_comments = comments_json["hotComments"]
with open('hot_comments.txt', 'w', encoding='utf-8') as file:
for each in hot_comments:
file.write(each['user']['nickname'] + '：\n\n')
file.write(each['content'] + '\n')
file.write("---------------------------------------\n")

复制代码

最佳答案

月排行榜 / 总排行榜

Twilight6

2020-7-26 08:03:49

hotComments 键，在 data 里面，你需要先读取 data ，然后在获取 hotComments

把 hot_comments = comments_json["hotComments"] 改成 hot_comments = comments_json["data"]["hotComments"]即可：

# -*- coding: utf-8 -*-

"""

Created on Sun Jul 26 00:18:36 2020

@author: Chang YF

"""

import requests

import json

headers = {

'user-agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.98 Safari/537.36',

'referer': 'http://music.163.com/'}

params = '3a1OtDUiNmbCVaP1B5CPYSeyY/wDsYmmJwYd2jd3aCYZeUxW1WFFrS0XeT4MZOVXl04cibj3INebigj8HJZ51ZjXarsRz92q1IGzamJtEtEsyHs9e611kL8S/bngl8HQWQMj6e3BT1t412zB0YWZ9QzbH0hHiTienBvLVm4hrH63aTjpBu5BCaxYQcM23QuwRvFC0sQyM5764/zw7gQEKz3zHhg+BH5rCfHVjnK+nc4DwiiEnRTXZ1S4LTLt9xpC8g9MQ2yXWhDEVQ0U4xxuPQ=='

encSecKey = 'b5295ea54521dd92971c8d7ec485ae485cd46e6ad78755856d559a497e82a697764d1659229c31c55a633bbc02f775a24e4df9b8b0019abc119979ffaadfbed6892fcab1e43155acc643e660f98dc67d86c89aaa5be8dbd9d3f4bba62ad25b1ab2342cc66dd09e40f26e23647d0e01c348511332ad6c7e33da504b0f8a4b4f00'

data = {'params': params, 'encSecKey': encSecKey}

url = 'https://music.163.com/#/song?id=4466775'

name_id = url.split('=')[1]

target = 'https://music.163.com/weapi/comment/resource/comments/get?csrf_token='

res = requests.post(target, headers=headers, data=data)

with open('res.txt', 'w', encoding='utf-8') as file:

file.write(res.text)

comments_json = json.loads(res.text)

print(comments_json)

hot_comments = comments_json['data']["hotComments"]

print(hot_comments)

with open('hot_comments.txt', 'w', encoding='utf-8') as file:

for each in hot_comments:

      file.write(each['user']['nickname'] + '：\n\n')

      file.write(each['content'] + '\n')

      file.write("---------------------------------------\n")
复制代码

跳转到最佳答案楼层

Twilight6 · 发表于 2020-7-26 08:03:49

这个最佳答案由 Twilight6 给出，感谢 Twilight6 的回答。

单击隐藏图章

hotComments 键，在 data 里面，你需要先读取 data ，然后在获取 hotComments

把 hot_comments = comments_json["hotComments"] 改成 hot_comments = comments_json["data"]["hotComments"]即可：

# -*- coding: utf-8 -*-

"""

Created on Sun Jul 26 00:18:36 2020

@author: Chang YF

"""

import requests

import json

headers = {

'user-agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.98 Safari/537.36',

'referer': 'http://music.163.com/'}

params = '3a1OtDUiNmbCVaP1B5CPYSeyY/wDsYmmJwYd2jd3aCYZeUxW1WFFrS0XeT4MZOVXl04cibj3INebigj8HJZ51ZjXarsRz92q1IGzamJtEtEsyHs9e611kL8S/bngl8HQWQMj6e3BT1t412zB0YWZ9QzbH0hHiTienBvLVm4hrH63aTjpBu5BCaxYQcM23QuwRvFC0sQyM5764/zw7gQEKz3zHhg+BH5rCfHVjnK+nc4DwiiEnRTXZ1S4LTLt9xpC8g9MQ2yXWhDEVQ0U4xxuPQ=='

encSecKey = 'b5295ea54521dd92971c8d7ec485ae485cd46e6ad78755856d559a497e82a697764d1659229c31c55a633bbc02f775a24e4df9b8b0019abc119979ffaadfbed6892fcab1e43155acc643e660f98dc67d86c89aaa5be8dbd9d3f4bba62ad25b1ab2342cc66dd09e40f26e23647d0e01c348511332ad6c7e33da504b0f8a4b4f00'

data = {'params': params, 'encSecKey': encSecKey}

url = 'https://music.163.com/#/song?id=4466775'

name_id = url.split('=')[1]

target = 'https://music.163.com/weapi/comment/resource/comments/get?csrf_token='

res = requests.post(target, headers=headers, data=data)

with open('res.txt', 'w', encoding='utf-8') as file:

file.write(res.text)

comments_json = json.loads(res.text)

print(comments_json)

hot_comments = comments_json['data']["hotComments"]

print(hot_comments)

with open('hot_comments.txt', 'w', encoding='utf-8') as file:

for each in hot_comments:

      file.write(each['user']['nickname'] + '：\n\n')

      file.write(each['content'] + '\n')

      file.write("---------------------------------------\n")
复制代码

ferious · 发表于 2020-11-24 18:08:57

Twilight6 发表于 2020-7-26 08:03
hotComments 键，在 data 里面，你需要先读取 data ，然后在获取 hotComments

把 hot_comments = com ...

帮我看看这个？

账号		自动登录	找回密码
密码			立即注册

[已解决]关于爬取网易云音乐评论的错误

马上注册，结交更多好友，享用更多功能^_^

浏览过的版块