[已解决]有没有大师帮写一个爬取基金净值的信息

13691255250

1. http://fundf10.eastmoney.com/jjjz_010810.html

复制代码

想爬取这个网页中下图圈出的所有净值数据，主要是他下面又翻页，但点翻页网址的不变的

最佳答案

月排行榜 / 总排行榜

ZhKQYu

2022-12-12 19:46:47

1. import requests
   
2. import json
   
3. 
   
4. cookies = {
   
5.     'st_si': '66348281762529',
   
6.     'st_pvi': '63968711429536',
   
7.     'st_sp': '2022-12-12%2021%3A15%3A52',
   
8.     'st_inirUrl': '',
   
9.     'st_sn': '1',
   
10.     'st_psi': '20221212211552388-112200305283-4580946598',
    
11.     'st_asi': 'delete',
    
12. }
    
13. 
    
14. headers = {
    
15.     'Accept': '*/*',
    
16.     'Accept-Language': 'zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US;q=0.6',
    
17.     # 'Cookie': 'st_si=66348281762529; st_pvi=63968711429536; st_sp=2022-12-12%2021%3A15%3A52; st_inirUrl=; st_sn=1; st_psi=20221212211552388-112200305283-4580946598; st_asi=delete',
    
18.     'Proxy-Connection': 'keep-alive',
    
19.     'Referer': 'http://fundf10.eastmoney.com/',
    
20.     'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36 Edg/108.0.1462.46',
    
21. }
    
22. 
    
23. # 抓取不同的基金，修改参数即可
    
24. params = {
    
25.     'callback': 'jQuery18301902553614780571_1670850964513',
    
26.     'fundCode': '010810',
    
27.     'pageIndex': '1',
    
28.     'pageSize': '10000',
    
29.     'startDate': '',
    
30.     'endDate': '',
    
31.     '_': '1670850964537',
    
32. }
    
33. 
    
34. response = requests.get('http://api.fund.eastmoney.com/f10/lsjz', params=params, cookies=cookies, headers=headers, verify=False)
    
35. data = json.loads(response.text[response.text.find('{'):response.text.rfind('}')+1])
    
36. data = data["Data"]["LSJZList"]
    
37. lst = []
    
38. for i in data:
    
39.     lst.append(i["LJJZ"])
    
40. print(lst)
    

复制代码

跳转到最佳答案楼层

ZhKQYu

1. import requests
   
2. import json
   
3. 
   
4. cookies = {
   
5.     'st_si': '66348281762529',
   
6.     'st_pvi': '63968711429536',
   
7.     'st_sp': '2022-12-12%2021%3A15%3A52',
   
8.     'st_inirUrl': '',
   
9.     'st_sn': '1',
   
10.     'st_psi': '20221212211552388-112200305283-4580946598',
    
11.     'st_asi': 'delete',
    
12. }
    
13. 
    
14. headers = {
    
15.     'Accept': '*/*',
    
16.     'Accept-Language': 'zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US;q=0.6',
    
17.     # 'Cookie': 'st_si=66348281762529; st_pvi=63968711429536; st_sp=2022-12-12%2021%3A15%3A52; st_inirUrl=; st_sn=1; st_psi=20221212211552388-112200305283-4580946598; st_asi=delete',
    
18.     'Proxy-Connection': 'keep-alive',
    
19.     'Referer': 'http://fundf10.eastmoney.com/',
    
20.     'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36 Edg/108.0.1462.46',
    
21. }
    
22. 
    
23. # 抓取不同的基金，修改参数即可
    
24. params = {
    
25.     'callback': 'jQuery18301902553614780571_1670850964513',
    
26.     'fundCode': '010810',
    
27.     'pageIndex': '1',
    
28.     'pageSize': '10000',
    
29.     'startDate': '',
    
30.     'endDate': '',
    
31.     '_': '1670850964537',
    
32. }
    
33. 
    
34. response = requests.get('http://api.fund.eastmoney.com/f10/lsjz', params=params, cookies=cookies, headers=headers, verify=False)
    
35. data = json.loads(response.text[response.text.find('{'):response.text.rfind('}')+1])
    
36. data = data["Data"]["LSJZList"]
    
37. lst = []
    
38. for i in data:
    
39.     lst.append(i["LJJZ"])
    
40. print(lst)
    

复制代码

cflying

你仔细看嘛，有个js接口的嘛

13691255250

ZhKQYu 发表于 2022-12-12 19:46

大神，想请问你一下，params参数里的最后一个键值对 '_': '1670850964537'的值你是怎么看的，我看每个页面的值好像都不一样

ZhKQYu

13691255250 发表于 2022-12-12 23:09
大神，想请问你一下，params参数里的最后一个键值对 '_': '1670850964537'的值你是怎么看的，我看每个页 ...

可能是哪里动态返回的，不加也没事

1. params = {
   
2.     # 'callback': 'jQuery18301902553614780571_1670850964513',
   
3.     'fundCode': '010810',
   
4.     'pageIndex': '1',
   
5.     'pageSize': '10000',
   
6.     'startDate': '',
   
7.     'endDate': '',
   
8.     # '_': '1670850964537',
   
9. }

复制代码

jackie-L

接口在这里自己随便写个程序就下载了
http://api.fund.eastmoney.com/f10/lsjz?callback=jQuery18304937712367452083_1670924388535&fundCode=010810&pageIndex=2&pageSize=20&startDate=&endDate=&_=1670924402259

廿四桥

向大神学习。