鱼C论坛

 找回密码
 立即注册
查看: 1813|回复: 2

[已解决]python爬虫求助

[复制链接]
发表于 2022-7-18 17:35:16 | 显示全部楼层 |阅读模式

马上注册,结交更多好友,享用更多功能^_^

您需要 登录 才可以下载或查看,没有账号?立即注册

x
这个网站可以https://www.juliangip.com/agent
可以大规模检测ip
我变了一个爬虫但效果不尽人意。
from urllib.request import *
from urllib.parse import *
url = 'https://www.juliangip.com/checkAgent'
data = {}

data['type']: 'http'
data['ipPort']: '47.105.91.226:8118'
head = {}
head['user-agent'] = 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.5112.39 Safari/537.36 Edg/104.0.1293.21'
data = urlencode(data).encode('utf-8')
req = Request(url,data,head)
xx = urlopen(req)
html = xx.read().decode('utf-8')
print(html)
最佳答案
2022-7-19 11:40:54
from urllib.request import *
from urllib.parse import *
url = 'https://www.juliangip.com/checkAgent'
data = {}

data['type'] = 'http'
data['ipPort'] = '47.105.91.226:8118'
head = {}
head['user-agent'] = 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.5112.39 Safari/537.36 Edg/104.0.1293.21'
data = urlencode(data).encode('utf-8')
req = Request(url,data,head)
xx = urlopen(req)
html = xx.read().decode('utf-8')
print(html)
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复

使用道具 举报

发表于 2022-7-19 08:42:39 | 显示全部楼层
what's your purpose?
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

发表于 2022-7-19 11:40:54 | 显示全部楼层    本楼为最佳答案   
from urllib.request import *
from urllib.parse import *
url = 'https://www.juliangip.com/checkAgent'
data = {}

data['type'] = 'http'
data['ipPort'] = '47.105.91.226:8118'
head = {}
head['user-agent'] = 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.5112.39 Safari/537.36 Edg/104.0.1293.21'
data = urlencode(data).encode('utf-8')
req = Request(url,data,head)
xx = urlopen(req)
html = xx.read().decode('utf-8')
print(html)
想知道小甲鱼最近在做啥?请访问 -> ilovefishc.com
回复 支持 反对

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

小黑屋|手机版|Archiver|鱼C工作室 ( 粤ICP备18085999号-1 | 粤公网安备 44051102000585号)

GMT+8, 2024-11-17 14:16

Powered by Discuz! X3.4

© 2001-2023 Discuz! Team.

快速回复 返回顶部 返回列表