设为首页收藏本站
切换到窄版

鱼C论坛

 找回密码
 立即注册
鱼C论坛»论坛 › 技术交流 › Python交流 › 关于爬虫的问题
12下一页
返回列表 发新帖
查看: 1675|回复: 28

[已解决]关于爬虫的问题

[复制链接]
新手·ing
发表于 2019-1-27 13:39:11 | 显示全部楼层 |阅读模式

马上注册，结交更多好友，享用更多功能^_^

您需要 登录 才可以下载或查看，没有账号？立即注册

x
数据地址：http://data.eastmoney.com/hsgt/top10.html
F1{$%S_U4S$`G[JIB~C5.png
红框为我想要的数据。
之前请教群里的大神，找到了沪股通也就是上面的数据地址，
http://dcfm.eastmoney.com//EM_MutiSvcExpandInterface/api/js/get?type=HSGTCJB&token=70f12f2f4f091e459a279469fe49eca5&sty=hgt&filter=(MarketType=1)(DetailDate=^2019-01-24^)&js=var%20khScsvEN={%22data%22:(x),%22pages%22:(tp)}&pagesize=50&page=1&sr=-1&st=HGTMCJE&rt=51611116&tdsourcetag=s_pctim_aiomsg
现在的问题是下面的数据，能不能找到数据地址。
最佳答案
月排行榜 / 总排行榜
wongyusing
2019-1-28 10:55:14
数据不是在网页源代码里面吗？？
  1. var DATA1 = {"data":[{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":1.0,"Rank1":"-","Code":"601318","Name":"中国平安","Close":61.29,"ChangePercent":1.4231,"HGTJME":13988364.0,"HGTMRJE":430456886.0,"HGTMCJE":416468522.0,"HGTCJJE":846925408.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":2.0,"Rank1":"-","Code":"600519","Name":"贵州茅台","Close":679.7,"ChangePercent":1.0706,"HGTJME":406483393.0,"HGTMRJE":504875954.0,"HGTMCJE":98392561.0,"HGTCJJE":603268515.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":3.0,"Rank1":"-","Code":"600036","Name":"招商银行","Close":28.52,"ChangePercent":2.3323,"HGTJME":-92145455.0,"HGTMRJE":142081397.0,"HGTMCJE":234226852.0,"HGTCJJE":376308249.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":4.0,"Rank1":"-","Code":"600887","Name":"伊利股份","Close":24.43,"ChangePercent":0.3698,"HGTJME":-75245848.0,"HGTMRJE":129396765.0,"HGTMCJE":204642613.0,"HGTCJJE":334039378.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":5.0,"Rank1":"-","Code":"600104","Name":"上汽集团","Close":26.23,"ChangePercent":2.0623,"HGTJME":-23751557.0,"HGTMRJE":147677327.0,"HGTMCJE":171428884.0,"HGTCJJE":319106211.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":6.0,"Rank1":"-","Code":"600276","Name":"恒瑞医药","Close":58.99,"ChangePercent":-0.6568,"HGTJME":-32501983.0,"HGTMRJE":135469370.0,"HGTMCJE":167971353.0,"HGTCJJE":303440723.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":7.0,"Rank1":"-","Code":"600585","Name":"海螺水泥","Close":31.32,"ChangePercent":1.8868,"HGTJME":-3314309.0,"HGTMRJE":136862189.0,"HGTMCJE":140176498.0,"HGTCJJE":277038687.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":8.0,"Rank1":"-","Code":"601888","Name":"中国国旅","Close":56.43,"ChangePercent":0.7679,"HGTJME":-122781668.0,"HGTMRJE":72507228.0,"HGTMCJE":195288896.0,"HGTCJJE":267796124.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":9.0,"Rank1":"-","Code":"600031","Name":"三一重工","Close":9.07,"ChangePercent":2.3702,"HGTJME":152905980.0,"HGTMRJE":196046256.0,"HGTMCJE":43140276.0,"HGTCJJE":239186532.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":10.0,"Rank1":"-","Code":"601398","Name":"工商银行","Close":5.52,"ChangePercent":1.0989,"HGTJME":163419284.0,"HGTMRJE":187351406.0,"HGTMCJE":23932122.0,"HGTCJJE":211283528.0}]};
  2.         var DATA2 = {"data":[{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":1.0,"Rank1":"-","Code":"000002","Name":"万科A","Close":26.1,"ChangePercent":2.7155,"SGTJME":221704343.0,"SGTMRJE":339581428.0,"SGTMCJE":117877085.0,"SGTCJJE":457458513.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":2.0,"Rank1":"-","Code":"000333","Name":"美的集团","Close":41.9,"ChangePercent":0.7454,"SGTJME":99904424.0,"SGTMRJE":246006220.0,"SGTMCJE":146101796.0,"SGTCJJE":392108016.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":3.0,"Rank1":"-","Code":"000858","Name":"五粮液","Close":55.25,"ChangePercent":0.0906,"SGTJME":-96388951.0,"SGTMRJE":140025249.0,"SGTMCJE":236414200.0,"SGTCJJE":376439449.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":4.0,"Rank1":"-","Code":"000651","Name":"格力电器","Close":39.9,"ChangePercent":1.3205,"SGTJME":235241812.0,"SGTMRJE":301652144.0,"SGTMCJE":66410332.0,"SGTCJJE":368062476.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":5.0,"Rank1":"-","Code":"000001","Name":"平安银行","Close":11.0,"ChangePercent":4.5627,"SGTJME":205182137.0,"SGTMRJE":256474338.0,"SGTMCJE":51292201.0,"SGTCJJE":307766539.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":6.0,"Rank1":"-","Code":"002415","Name":"海康威视","Close":29.3,"ChangePercent":1.5246,"SGTJME":77672308.0,"SGTMRJE":191273396.0,"SGTMCJE":113601088.0,"SGTCJJE":304874484.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":7.0,"Rank1":"-","Code":"002008","Name":"大族激光","Close":31.3,"ChangePercent":4.0558,"SGTJME":152593898.0,"SGTMRJE":172381044.0,"SGTMCJE":19787146.0,"SGTCJJE":192168190.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":8.0,"Rank1":"-","Code":"000338","Name":"潍柴动力","Close":8.6,"ChangePercent":3.2413,"SGTJME":98746508.0,"SGTMRJE":130107489.0,"SGTMCJE":31360981.0,"SGTCJJE":161468470.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":9.0,"Rank1":"-","Code":"002304","Name":"洋河股份","Close":98.66,"ChangePercent":-0.4038,"SGTJME":57751064.0,"SGTMRJE":96265906.0,"SGTMCJE":38514842.0,"SGTCJJE":134780748.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":10.0,"Rank1":"-","Code":"002475","Name":"立讯精密","Close":15.58,"ChangePercent":3.1788,"SGTJME":44413324.0,"SGTMRJE":81787321.0,"SGTMCJE":37373997.0,"SGTCJJE":119161318.0}]};
  3.         var DATA3 = {"data":[{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":1.0,"Rank1":1.0,"Code":"00700","Name":"腾讯控股","Close":343.8,"ChangePercent":4.1187,"GGTHJME":1008749120.0,"GGTHMRJE":1246850620.0,"GGTHMCJE":238101500.0,"GGTHCJJE":1484952120.0,"GGTSJME":-31984300.0,"GGTSMRJE":76738340.0,"GGTSMCJE":108722640.0,"GGTSCJJE":185460980.0,"GGTJME":976764820.0,"GGTCJL":3155365220.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":2.0,"Rank1":2.0,"Code":"01918","Name":"融创中国","Close":27.8,"ChangePercent":2.7726,"GGTHJME":-322526300.0,"GGTHMRJE":465010900.0,"GGTHMCJE":787537200.0,"GGTHCJJE":1252548100.0,"GGTSJME":5637750.0,"GGTSMRJE":84807450.0,"GGTSMCJE":79169700.0,"GGTSCJJE":163977150.0,"GGTJME":-316888550.0,"GGTCJL":1416525250.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":3.0,"Rank1":10.0,"Code":"01398","Name":"工商银行","Close":5.97,"ChangePercent":2.226,"GGTHJME":-508601550.0,"GGTHMRJE":10551080.0,"GGTHMCJE":519152630.0,"GGTHCJJE":529703710.0,"GGTSJME":47240840.0,"GGTSMRJE":51420940.0,"GGTSMCJE":4180100.0,"GGTSCJJE":55601040.0,"GGTJME":-461360710.0,"GGTCJL":1115008460.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":4.0,"Rank1":3.0,"Code":"00939","Name":"建设银行","Close":6.82,"ChangePercent":1.791,"GGTHJME":-68381150.0,"GGTHMRJE":150585430.0,"GGTHMCJE":218966580.0,"GGTHCJJE":369552010.0,"GGTSJME":70009700.0,"GGTSMRJE":77291080.0,"GGTSMCJE":7281380.0,"GGTSCJJE":84572460.0,"GGTJME":1628550.0,"GGTCJL":823676480.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":5.0,"Rank1":"-","Code":"00788","Name":"中国铁塔","Close":1.73,"ChangePercent":2.9762,"GGTHJME":136955380.0,"GGTHMRJE":235519960.0,"GGTHMCJE":98564580.0,"GGTHCJJE":334084540.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":136955380.0,"GGTCJL":334084540.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":6.0,"Rank1":"-","Code":"03988","Name":"中国银行","Close":3.59,"ChangePercent":2.5714,"GGTHJME":-29495330.0,"GGTHMRJE":93713740.0,"GGTHMCJE":123209070.0,"GGTHCJJE":216922810.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":-29495330.0,"GGTCJL":216922810.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":7.0,"Rank1":"-","Code":"02382","Name":"舜宇光学科技","Close":76.55,"ChangePercent":4.863,"GGTHJME":-149955205.0,"GGTHMRJE":32128380.0,"GGTHMCJE":182083585.0,"GGTHCJJE":214211965.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":-149955205.0,"GGTCJL":214211965.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":8.0,"Rank1":"-","Code":"02318","Name":"中国平安","Close":73.4,"ChangePercent":1.5917,"GGTHJME":178949975.0,"GGTHMRJE":190975800.0,"GGTHMCJE":12025825.0,"GGTHCJJE":203001625.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":178949975.0,"GGTCJL":203001625.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":9.0,"Rank1":"-","Code":"03968","Name":"招商银行","Close":32.6,"ChangePercent":2.3548,"GGTHJME":-145444125.0,"GGTHMRJE":11450350.0,"GGTHMCJE":156894475.0,"GGTHCJJE":168344825.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":-145444125.0,"GGTCJL":168344825.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":10.0,"Rank1":"-","Code":"01336","Name":"新华保险","Close":30.35,"ChangePercent":2.0168,"GGTHJME":-7267255.0,"GGTHMRJE":70090050.0,"GGTHMCJE":77357305.0,"GGTHCJJE":147447355.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":-7267255.0,"GGTCJL":147447355.0}]};
  4.         var DATA4 = {"data":[{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":1.0,"Rank1":1.0,"Code":"00700","Name":"腾讯控股","Close":343.8,"ChangePercent":4.1187,"GGTHJME":1008749120.0,"GGTHMRJE":1246850620.0,"GGTHMCJE":238101500.0,"GGTHCJJE":1484952120.0,"GGTSJME":-31984300.0,"GGTSMRJE":76738340.0,"GGTSMCJE":108722640.0,"GGTSCJJE":185460980.0,"GGTJME":976764820.0,"GGTCJL":1670413100.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":2.0,"Rank1":2.0,"Code":"01918","Name":"融创中国","Close":27.8,"ChangePercent":2.7726,"GGTHJME":-322526300.0,"GGTHMRJE":465010900.0,"GGTHMCJE":787537200.0,"GGTHCJJE":1252548100.0,"GGTSJME":5637750.0,"GGTSMRJE":84807450.0,"GGTSMCJE":79169700.0,"GGTSCJJE":163977150.0,"GGTJME":-316888550.0,"GGTCJL":1580502400.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":4.0,"Rank1":3.0,"Code":"00939","Name":"建设银行","Close":6.82,"ChangePercent":1.791,"GGTHJME":-68381150.0,"GGTHMRJE":150585430.0,"GGTHMCJE":218966580.0,"GGTHCJJE":369552010.0,"GGTSJME":70009700.0,"GGTSMRJE":77291080.0,"GGTSMCJE":7281380.0,"GGTSCJJE":84572460.0,"GGTJME":1628550.0,"GGTCJL":454124470.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":4.0,"Code":"02208","Name":"金风科技","Close":8.26,"ChangePercent":5.0891,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":-30628458.0,"GGTSMRJE":22695624.0,"GGTSMCJE":53324082.0,"GGTSCJJE":76019706.0,"GGTJME":-30628458.0,"GGTCJL":76019706.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":5.0,"Code":"00175","Name":"吉利汽车","Close":13.38,"ChangePercent":5.0235,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":-36551560.0,"GGTSMRJE":18072720.0,"GGTSMCJE":54624280.0,"GGTSCJJE":72697000.0,"GGTJME":-36551560.0,"GGTCJL":72697000.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":6.0,"Code":"00354","Name":"中国软件国际","Close":3.98,"ChangePercent":6.1333,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":-21010920.0,"GGTSMRJE":25494880.0,"GGTSMCJE":46505800.0,"GGTSCJJE":72000680.0,"GGTJME":-21010920.0,"GGTCJL":72000680.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":7.0,"Code":"02601","Name":"中国太保","Close":27.4,"ChangePercent":2.4299,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":57715750.0,"GGTSMRJE":60334600.0,"GGTSMCJE":2618850.0,"GGTSCJJE":62953450.0,"GGTJME":57715750.0,"GGTCJL":62953450.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":8.0,"Code":"00762","Name":"中国联通","Close":9.07,"ChangePercent":0.443,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":-60692800.0,"GGTSMRJE":54300.0,"GGTSMCJE":60747100.0,"GGTSCJJE":60801400.0,"GGTJME":-60692800.0,"GGTCJL":60801400.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":9.0,"Code":"00976","Name":"齐合环保","Close":1.31,"ChangePercent":8.2645,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":-13384700.0,"GGTSMRJE":23634340.0,"GGTSMCJE":37019040.0,"GGTSCJJE":60653380.0,"GGTJME":-13384700.0,"GGTCJL":60653380.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":3.0,"Rank1":10.0,"Code":"01398","Name":"工商银行","Close":5.97,"ChangePercent":2.226,"GGTHJME":-508601550.0,"GGTHMRJE":10551080.0,"GGTHMCJE":519152630.0,"GGTHCJJE":529703710.0,"GGTSJME":47240840.0,"GGTSMRJE":51420940.0,"GGTSMCJE":4180100.0,"GGTSCJJE":55601040.0,"GGTJME":-461360710.0,"GGTCJL":585304750.0}]};

复制代码
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复

使用道具 举报

wongyusing
发表于 2019-1-28 10:55:14 | 显示全部楼层    本楼为最佳答案   
数据不是在网页源代码里面吗？？
  1. var DATA1 = {"data":[{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":1.0,"Rank1":"-","Code":"601318","Name":"中国平安","Close":61.29,"ChangePercent":1.4231,"HGTJME":13988364.0,"HGTMRJE":430456886.0,"HGTMCJE":416468522.0,"HGTCJJE":846925408.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":2.0,"Rank1":"-","Code":"600519","Name":"贵州茅台","Close":679.7,"ChangePercent":1.0706,"HGTJME":406483393.0,"HGTMRJE":504875954.0,"HGTMCJE":98392561.0,"HGTCJJE":603268515.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":3.0,"Rank1":"-","Code":"600036","Name":"招商银行","Close":28.52,"ChangePercent":2.3323,"HGTJME":-92145455.0,"HGTMRJE":142081397.0,"HGTMCJE":234226852.0,"HGTCJJE":376308249.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":4.0,"Rank1":"-","Code":"600887","Name":"伊利股份","Close":24.43,"ChangePercent":0.3698,"HGTJME":-75245848.0,"HGTMRJE":129396765.0,"HGTMCJE":204642613.0,"HGTCJJE":334039378.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":5.0,"Rank1":"-","Code":"600104","Name":"上汽集团","Close":26.23,"ChangePercent":2.0623,"HGTJME":-23751557.0,"HGTMRJE":147677327.0,"HGTMCJE":171428884.0,"HGTCJJE":319106211.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":6.0,"Rank1":"-","Code":"600276","Name":"恒瑞医药","Close":58.99,"ChangePercent":-0.6568,"HGTJME":-32501983.0,"HGTMRJE":135469370.0,"HGTMCJE":167971353.0,"HGTCJJE":303440723.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":7.0,"Rank1":"-","Code":"600585","Name":"海螺水泥","Close":31.32,"ChangePercent":1.8868,"HGTJME":-3314309.0,"HGTMRJE":136862189.0,"HGTMCJE":140176498.0,"HGTCJJE":277038687.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":8.0,"Rank1":"-","Code":"601888","Name":"中国国旅","Close":56.43,"ChangePercent":0.7679,"HGTJME":-122781668.0,"HGTMRJE":72507228.0,"HGTMCJE":195288896.0,"HGTCJJE":267796124.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":9.0,"Rank1":"-","Code":"600031","Name":"三一重工","Close":9.07,"ChangePercent":2.3702,"HGTJME":152905980.0,"HGTMRJE":196046256.0,"HGTMCJE":43140276.0,"HGTCJJE":239186532.0},{"MarketType":1.0,"DetailDate":"2019-01-25T00:00:00","Rank":10.0,"Rank1":"-","Code":"601398","Name":"工商银行","Close":5.52,"ChangePercent":1.0989,"HGTJME":163419284.0,"HGTMRJE":187351406.0,"HGTMCJE":23932122.0,"HGTCJJE":211283528.0}]};
  2.         var DATA2 = {"data":[{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":1.0,"Rank1":"-","Code":"000002","Name":"万科A","Close":26.1,"ChangePercent":2.7155,"SGTJME":221704343.0,"SGTMRJE":339581428.0,"SGTMCJE":117877085.0,"SGTCJJE":457458513.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":2.0,"Rank1":"-","Code":"000333","Name":"美的集团","Close":41.9,"ChangePercent":0.7454,"SGTJME":99904424.0,"SGTMRJE":246006220.0,"SGTMCJE":146101796.0,"SGTCJJE":392108016.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":3.0,"Rank1":"-","Code":"000858","Name":"五粮液","Close":55.25,"ChangePercent":0.0906,"SGTJME":-96388951.0,"SGTMRJE":140025249.0,"SGTMCJE":236414200.0,"SGTCJJE":376439449.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":4.0,"Rank1":"-","Code":"000651","Name":"格力电器","Close":39.9,"ChangePercent":1.3205,"SGTJME":235241812.0,"SGTMRJE":301652144.0,"SGTMCJE":66410332.0,"SGTCJJE":368062476.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":5.0,"Rank1":"-","Code":"000001","Name":"平安银行","Close":11.0,"ChangePercent":4.5627,"SGTJME":205182137.0,"SGTMRJE":256474338.0,"SGTMCJE":51292201.0,"SGTCJJE":307766539.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":6.0,"Rank1":"-","Code":"002415","Name":"海康威视","Close":29.3,"ChangePercent":1.5246,"SGTJME":77672308.0,"SGTMRJE":191273396.0,"SGTMCJE":113601088.0,"SGTCJJE":304874484.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":7.0,"Rank1":"-","Code":"002008","Name":"大族激光","Close":31.3,"ChangePercent":4.0558,"SGTJME":152593898.0,"SGTMRJE":172381044.0,"SGTMCJE":19787146.0,"SGTCJJE":192168190.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":8.0,"Rank1":"-","Code":"000338","Name":"潍柴动力","Close":8.6,"ChangePercent":3.2413,"SGTJME":98746508.0,"SGTMRJE":130107489.0,"SGTMCJE":31360981.0,"SGTCJJE":161468470.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":9.0,"Rank1":"-","Code":"002304","Name":"洋河股份","Close":98.66,"ChangePercent":-0.4038,"SGTJME":57751064.0,"SGTMRJE":96265906.0,"SGTMCJE":38514842.0,"SGTCJJE":134780748.0},{"MarketType":3.0,"DetailDate":"2019-01-25T00:00:00","Rank":10.0,"Rank1":"-","Code":"002475","Name":"立讯精密","Close":15.58,"ChangePercent":3.1788,"SGTJME":44413324.0,"SGTMRJE":81787321.0,"SGTMCJE":37373997.0,"SGTCJJE":119161318.0}]};
  3.         var DATA3 = {"data":[{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":1.0,"Rank1":1.0,"Code":"00700","Name":"腾讯控股","Close":343.8,"ChangePercent":4.1187,"GGTHJME":1008749120.0,"GGTHMRJE":1246850620.0,"GGTHMCJE":238101500.0,"GGTHCJJE":1484952120.0,"GGTSJME":-31984300.0,"GGTSMRJE":76738340.0,"GGTSMCJE":108722640.0,"GGTSCJJE":185460980.0,"GGTJME":976764820.0,"GGTCJL":3155365220.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":2.0,"Rank1":2.0,"Code":"01918","Name":"融创中国","Close":27.8,"ChangePercent":2.7726,"GGTHJME":-322526300.0,"GGTHMRJE":465010900.0,"GGTHMCJE":787537200.0,"GGTHCJJE":1252548100.0,"GGTSJME":5637750.0,"GGTSMRJE":84807450.0,"GGTSMCJE":79169700.0,"GGTSCJJE":163977150.0,"GGTJME":-316888550.0,"GGTCJL":1416525250.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":3.0,"Rank1":10.0,"Code":"01398","Name":"工商银行","Close":5.97,"ChangePercent":2.226,"GGTHJME":-508601550.0,"GGTHMRJE":10551080.0,"GGTHMCJE":519152630.0,"GGTHCJJE":529703710.0,"GGTSJME":47240840.0,"GGTSMRJE":51420940.0,"GGTSMCJE":4180100.0,"GGTSCJJE":55601040.0,"GGTJME":-461360710.0,"GGTCJL":1115008460.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":4.0,"Rank1":3.0,"Code":"00939","Name":"建设银行","Close":6.82,"ChangePercent":1.791,"GGTHJME":-68381150.0,"GGTHMRJE":150585430.0,"GGTHMCJE":218966580.0,"GGTHCJJE":369552010.0,"GGTSJME":70009700.0,"GGTSMRJE":77291080.0,"GGTSMCJE":7281380.0,"GGTSCJJE":84572460.0,"GGTJME":1628550.0,"GGTCJL":823676480.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":5.0,"Rank1":"-","Code":"00788","Name":"中国铁塔","Close":1.73,"ChangePercent":2.9762,"GGTHJME":136955380.0,"GGTHMRJE":235519960.0,"GGTHMCJE":98564580.0,"GGTHCJJE":334084540.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":136955380.0,"GGTCJL":334084540.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":6.0,"Rank1":"-","Code":"03988","Name":"中国银行","Close":3.59,"ChangePercent":2.5714,"GGTHJME":-29495330.0,"GGTHMRJE":93713740.0,"GGTHMCJE":123209070.0,"GGTHCJJE":216922810.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":-29495330.0,"GGTCJL":216922810.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":7.0,"Rank1":"-","Code":"02382","Name":"舜宇光学科技","Close":76.55,"ChangePercent":4.863,"GGTHJME":-149955205.0,"GGTHMRJE":32128380.0,"GGTHMCJE":182083585.0,"GGTHCJJE":214211965.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":-149955205.0,"GGTCJL":214211965.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":8.0,"Rank1":"-","Code":"02318","Name":"中国平安","Close":73.4,"ChangePercent":1.5917,"GGTHJME":178949975.0,"GGTHMRJE":190975800.0,"GGTHMCJE":12025825.0,"GGTHCJJE":203001625.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":178949975.0,"GGTCJL":203001625.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":9.0,"Rank1":"-","Code":"03968","Name":"招商银行","Close":32.6,"ChangePercent":2.3548,"GGTHJME":-145444125.0,"GGTHMRJE":11450350.0,"GGTHMCJE":156894475.0,"GGTHCJJE":168344825.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":-145444125.0,"GGTCJL":168344825.0},{"MarketType":2.0,"DetailDate":"2019-01-25T00:00:00","Rank":10.0,"Rank1":"-","Code":"01336","Name":"新华保险","Close":30.35,"ChangePercent":2.0168,"GGTHJME":-7267255.0,"GGTHMRJE":70090050.0,"GGTHMCJE":77357305.0,"GGTHCJJE":147447355.0,"GGTSJME":"-","GGTSMRJE":"-","GGTSMCJE":"-","GGTSCJJE":"-","GGTJME":-7267255.0,"GGTCJL":147447355.0}]};
  4.         var DATA4 = {"data":[{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":1.0,"Rank1":1.0,"Code":"00700","Name":"腾讯控股","Close":343.8,"ChangePercent":4.1187,"GGTHJME":1008749120.0,"GGTHMRJE":1246850620.0,"GGTHMCJE":238101500.0,"GGTHCJJE":1484952120.0,"GGTSJME":-31984300.0,"GGTSMRJE":76738340.0,"GGTSMCJE":108722640.0,"GGTSCJJE":185460980.0,"GGTJME":976764820.0,"GGTCJL":1670413100.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":2.0,"Rank1":2.0,"Code":"01918","Name":"融创中国","Close":27.8,"ChangePercent":2.7726,"GGTHJME":-322526300.0,"GGTHMRJE":465010900.0,"GGTHMCJE":787537200.0,"GGTHCJJE":1252548100.0,"GGTSJME":5637750.0,"GGTSMRJE":84807450.0,"GGTSMCJE":79169700.0,"GGTSCJJE":163977150.0,"GGTJME":-316888550.0,"GGTCJL":1580502400.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":4.0,"Rank1":3.0,"Code":"00939","Name":"建设银行","Close":6.82,"ChangePercent":1.791,"GGTHJME":-68381150.0,"GGTHMRJE":150585430.0,"GGTHMCJE":218966580.0,"GGTHCJJE":369552010.0,"GGTSJME":70009700.0,"GGTSMRJE":77291080.0,"GGTSMCJE":7281380.0,"GGTSCJJE":84572460.0,"GGTJME":1628550.0,"GGTCJL":454124470.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":4.0,"Code":"02208","Name":"金风科技","Close":8.26,"ChangePercent":5.0891,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":-30628458.0,"GGTSMRJE":22695624.0,"GGTSMCJE":53324082.0,"GGTSCJJE":76019706.0,"GGTJME":-30628458.0,"GGTCJL":76019706.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":5.0,"Code":"00175","Name":"吉利汽车","Close":13.38,"ChangePercent":5.0235,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":-36551560.0,"GGTSMRJE":18072720.0,"GGTSMCJE":54624280.0,"GGTSCJJE":72697000.0,"GGTJME":-36551560.0,"GGTCJL":72697000.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":6.0,"Code":"00354","Name":"中国软件国际","Close":3.98,"ChangePercent":6.1333,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":-21010920.0,"GGTSMRJE":25494880.0,"GGTSMCJE":46505800.0,"GGTSCJJE":72000680.0,"GGTJME":-21010920.0,"GGTCJL":72000680.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":7.0,"Code":"02601","Name":"中国太保","Close":27.4,"ChangePercent":2.4299,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":57715750.0,"GGTSMRJE":60334600.0,"GGTSMCJE":2618850.0,"GGTSCJJE":62953450.0,"GGTJME":57715750.0,"GGTCJL":62953450.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":8.0,"Code":"00762","Name":"中国联通","Close":9.07,"ChangePercent":0.443,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":-60692800.0,"GGTSMRJE":54300.0,"GGTSMCJE":60747100.0,"GGTSCJJE":60801400.0,"GGTJME":-60692800.0,"GGTCJL":60801400.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":"-","Rank1":9.0,"Code":"00976","Name":"齐合环保","Close":1.31,"ChangePercent":8.2645,"GGTHJME":"-","GGTHMRJE":"-","GGTHMCJE":"-","GGTHCJJE":"-","GGTSJME":-13384700.0,"GGTSMRJE":23634340.0,"GGTSMCJE":37019040.0,"GGTSCJJE":60653380.0,"GGTJME":-13384700.0,"GGTCJL":60653380.0},{"MarketType":4.0,"DetailDate":"2019-01-25T00:00:00","Rank":3.0,"Rank1":10.0,"Code":"01398","Name":"工商银行","Close":5.97,"ChangePercent":2.226,"GGTHJME":-508601550.0,"GGTHMRJE":10551080.0,"GGTHMCJE":519152630.0,"GGTHCJJE":529703710.0,"GGTSJME":47240840.0,"GGTSMRJE":51420940.0,"GGTSMCJE":4180100.0,"GGTSCJJE":55601040.0,"GGTJME":-461360710.0,"GGTCJL":585304750.0}]};

复制代码
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

新手·ing
 楼主| 发表于 2019-1-28 15:21:34 | 显示全部楼层
wongyusing 发表于 2019-1-28 10:55
数据不是在网页源代码里面吗？？

查看源代码没有呢
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

wongyusing
发表于 2019-1-28 15:33:55 | 显示全部楼层
新手·ing 发表于 2019-1-28 15:21
查看源代码没有呢

你要，
右键网页，查看网页源代码。
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

Stubborn
发表于 2019-1-28 16:20:00 | 显示全部楼层
网页源码最下面有大哥~收小弟吗
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

Stubborn
发表于 2019-1-28 16:20:31 | 显示全部楼层
wongyusing 发表于 2019-1-28 15:33
你要，
右键网页，查看网页源代码。

大哥~收小弟吗
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

新手·ing
 楼主| 发表于 2019-1-28 16:20:41 | 显示全部楼层
wongyusing 发表于 2019-1-28 15:33
你要，
右键网页，查看网页源代码。

<td></td>
中间是空的
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

新手·ing
 楼主| 发表于 2019-1-28 16:21:12 | 显示全部楼层
Stubborn 发表于 2019-1-28 16:20
网页源码最下面有大哥~收小弟吗

真的没有
这是异步加载的，我想找接口。
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

塔利班
发表于 2019-1-28 16:30:16 | 显示全部楼层
查看源代码不是审查元素，可以找到到4个DATA集，网页加载后把表单填进表格
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

wongyusing
发表于 2019-1-28 16:40:12 | 显示全部楼层
Stubborn 发表于 2019-1-28 16:20
大哥~收小弟吗

不收，我只收富婆
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 2 反对 0

使用道具 举报

wongyusing
发表于 2019-1-28 16:40:50 | 显示全部楼层
新手·ing 发表于 2019-1-28 16:20
中间是空的


别看审查元素啊，看网页源代码
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

新手·ing
 楼主| 发表于 2019-1-28 16:43:16 | 显示全部楼层
wongyusing 发表于 2019-1-28 16:40
别看审查元素啊，看网页源代码

右键，网页源代码，空的...
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

wongyusing
发表于 2019-1-28 16:45:29 | 显示全部楼层
屏幕快照 2019-01-28 16.43.59.png
哪里是空的？？？
你Crtl + U 网页
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

wongyusing
发表于 2019-1-28 16:47:27 | 显示全部楼层
数据是json的形式，不是html
如果只是想获取股票信息，你可以用tushare包，获取。
如果是练习爬虫，那就要分清楚，审查元素和查看网页源代码的区别。
和爬虫的基础
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

Stubborn
发表于 2019-1-28 16:59:47 | 显示全部楼层
wongyusing 发表于 2019-1-28 16:47
数据是json的形式，不是html
如果只是想获取股票信息，你可以用tushare包，获取。
如果是练习爬虫，那就 ...

我也有疑问，在源码里面看到了，能直接获取吗
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

wongyusing
发表于 2019-1-28 17:03:25 | 显示全部楼层
Stubborn 发表于 2019-1-28 16:59
我也有疑问，在源码里面看到了，能直接获取吗

先用正则，然后再用pandas或json处理就行了。
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

wongyusing
发表于 2019-1-28 17:10:27 | 显示全部楼层
新手·ing 发表于 2019-1-28 16:43
右键，网页源代码，空的...

你打开下面的这个地址看看吧
  1. view-source:http://data.eastmoney.com/hsgt/top10.html
复制代码
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

Stubborn
发表于 2019-1-28 17:42:34 | 显示全部楼层
wongyusing 发表于 2019-1-28 17:10
你打开下面的这个地址看看吧


有个疑问，比如我要在不同的网站抓取相似的类容，比如IP地址和端口，需要对每个网站进行分开处理吗？还是全部用正则直接匹配？
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

wongyusing
发表于 2019-1-28 18:24:28 | 显示全部楼层
Stubborn 发表于 2019-1-28 17:42
有个疑问，比如我要在不同的网站抓取相似的类容，比如IP地址和端口，需要对每个网站进行分开处理吗？还 ...

只能说看情况，有时候需要特定写法，有时候却不需要。
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

Stubborn
发表于 2019-1-28 18:42:07 | 显示全部楼层
wongyusing 发表于 2019-1-28 18:24
只能说看情况，有时候需要特定写法，有时候却不需要。

正则比较通用一些是吗？通用爬虫有什么可以参考的链接吗？
想知道小甲鱼最近在做啥？请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

下一页 »
12下一页
返回列表 发新帖
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

小黑屋|手机版|Archiver|鱼C工作室 ( 粤ICP备18085999号-1 | 粤公网安备 44051102000585号)

GMT+8, 2024-4-26 08:52

Powered by Discuz! X3.4

© 2001-2023 Discuz! Team.

快速回复 返回顶部 返回列表