爬虫问题。单个链接能爬取出来，使用for循环，结果是空列表

wk934530

1. ls = ['http://lwj.sanya.gov.cn/wljsite/ydtj/list2.shtml/wljsite/ydtj/202203/b43442ca2f8c4ca5a9f8d10186b8a8f1.shtml',
   
2. 'http://lwj.sanya.gov.cn/wljsite/ydtj/list2.shtml/wljsite/ydtj/202202/d7498541d147437ea352be69f0080ded.shtml',
   
3. 'http://lwj.sanya.gov.cn/wljsite/ydtj/list2.shtml/wljsite/ydtj/202201/446aa96ff45c49bcb52a2facc02b6cd2.shtml']
   
4. 
   
5. def sylv(link):
   
6.     r = requests.get(link,headers=headers)
   
7.     r.encoding = 'utf-8'
   
8.     html1 = etree.HTML(r.text)
   
9. 
   
10. 
    
11.     link_xpath = html1.xpath('//*[@id="news_content"]/ucapcontent//text()')
    
12. 
    
13.     #去除不必要字符
    
14.     link_xpath = [el.replace('\r\n', '') for el in link_xpath]
    
15.     print(link_xpath)
    
16.    
    
17.     data_n = link_xpath
    
18.     f = r"C:\Users\13783\Desktop\test.txt"
    
19.     a = data_n
    
20.     with open(f,"a") as file:
    
21.         for i in range(len(a)):
    
22.             file.write(str(a[i]) + "d" + " "+"\n")
    
23.         file.write('*'*50)
    
24.         
    
25. for t in ls:
    
26.     sylv(t)

复制代码

suchocolate

headers赋值了吗？代码发全

wk934530

suchocolate 发表于 2022-4-10 16:13
headers赋值了吗？代码发全

你好，headers赋值了

suchocolate

wk934530 发表于 2022-4-10 22:47
你好，headers赋值了

没看到