|
马上注册,结交更多好友,享用更多功能^_^
您需要 登录 才可以下载或查看,没有账号?立即注册
x
用pycharm进行百度查询访问,写的代码报错 明明该放的cookie和useragent都填了 为啥还报错,现在爬虫不行了吗??
import requests
from bs4 import BeautifulSoup
headers={
'cookie':'BIDUPSID=08C9F5D4A4F569C36075B35C5D869A88; PSTM=1530794132; BDUSS=I1ZXRRREF3Si11NWFNeGIxZDV6S2RBd1ZYOTNUdHVtOXhQcDNSbHc1LUVuMnBnRVFBQUFBJCQAAAAAAAAAAAEAAAAktD4Kd2FuZ2FvamluZzE5ODYAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAIQSQ2CEEkNgS3; BDUSS_BFESS=I1ZXRRREF3Si11NWFNeGIxZDV6S2RBd1ZYOTNUdHVtOXhQcDNSbHc1LUVuMnBnRVFBQUFBJCQAAAAAAAAAAAEAAAAktD4Kd2FuZ2FvamluZzE5ODYAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAIQSQ2CEEkNgS3; __yjs_duid=1_44bf0e6b8495bbe92a7f6af0e40a72761619228955118; BD_UPN=12314753; BAIDUID=2405AB3C7E466BEA0B59F59EEDF5FE31:FG=1; H_WISE_SIDS=110085_127969_179348_184716_185635_188333_189755_191067_191250_192389_194085_194512_194530_195342_195467_196425_196527_197241_197711_197956_198271_198418_199466_199578_200150_201107_201183_201191_201537_201576_202059_202476_202651_202759_202847_202910_203197_203264_203310_203361_203525_203606_203885_203988_204031_204101_204131_204201_204265_204404_204675_204725_204823_204904_204940_205009_205086_205095_205173_205218_205229_205235_205413_205419_205484_205690_205806_205831_205921_205958_206171_206285_206728_206804; plus_cv=1::m:7.94e+147; ab_sr=1.0.1_OTExOTkzZGZhNzY4N2UzOTRiN2ZmZmNkZTNkY2I2YTlkYTYzNTQzMWMwN2EwMTRiNDAyYjhlMjMzYTIzYWExOGM2MmMxYWM4NzA2ZGZjMjQ4NjEzZDIzNDViMzRiNDU2MGY5ZTQ2NjFjMDAyMDkzOTA0ZDIyNWQyODRlMDAwNTQxY2QwMWMyN2I4Njc2NjNhNjY1ZTMxNGFmMWYwNTYyZjFkNGQ4MmEzZDA4MjFjMTIwM2EyODM0OGRjODMwZTBl; H_PS_PSSID=31660_26350; BDORZ=FFFB88E999055A3F8A630C64834BD6D0; BDRCVFR[fq555l35Iot]=pDgu-4B3j7tIZ-EIy7GQhPEUf; BD_HOME=1; sugstore=0; delPer=0; BD_CK_SAM=1; PSINO=3; H_PS_645EC=1bd12avffxCkyi6AoJUi/dZxEdptDEvxQNrHh4vFJ0u/5gB3w0/rVX99q+nMq0QDR6NdXyCpcZV/; BA_HECTOR=258k0h2h2l852kakmr1h35nn30q; BDSVRTM=227; COOKIE_SESSION=6913_2_7_9_4_4_1_0_6_3_1_0_104643_1113_0_0_1647493759_1647348903_1647501026|9#1173_54_1647348901|9'
'User-Agent':'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.107 Mobile Safari/537.36'
}
url='https://www.baidu.com/s?wd=python'
html=requests.get(url)
html.encoding=html.apparent_encoding
soup=BeautifulSoup(html.text,'lxml')
urls=soup.select('div.result.c-container h3 a')
for i in urls:
print(u['href'])
报错说明:
File "C:/Users/shun/PycharmProjects/pythonProject/2022315.py", line 21
'User-Agent':'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.107 Mobile Safari/537.36'
^
SyntaxError: invalid syntax
Process finished with exit code 1
|
-
|