[已解决]为什么编写爬虫，idle什么也不运行，也不报错呢？

校外也要读研

如题，代码完全照视频或作业答案，同时也照书上代码打了，都无法运行。。。

最佳答案

月排行榜 / 总排行榜

suchocolate

2021-6-18 23:49:40

1. from urllib import request
   
2. import re
   
3. from bs4 import BeautifulSoup
   
4. 
   
5. 
   
6. def main():
   
7.     url = "http://baike.baidu.com/view/284853.htm"
   
8.     headers = {'User-Agent': 'Firefox'}   # 得改header防反扒
   
9.     req = request.Request(url, headers=headers)
   
10.     r = request.urlopen(req)
    
11.     html = r.read().decode('utf-8')
    
12.     soup = BeautifulSoup(html, "html.parser")
    
13.     for each in soup.find_all(href=re.compile("view")):
    
14.         print(each.text, "->", ''.join(["http://baike.baidu.com", each["href"]]))
    
15. 
    
16. 
    
17. if __name__ == "__main__":
    
18.     main()

复制代码

跳转到最佳答案楼层

wp231957

为啥不放代码？谁知道你在说啥？

Twilight6

问问题养成贴代码的习惯，否则和纸上谈兵没什么区别

校外也要读研

file:///C:/Users/Administrator/Desktop/%E6%96%B0%E5%BB%BA%E4%BD%8D%E5%9B%BE%E5%9B%BE%E5%83%8F.bmp
import urllib.request
import re
from bs4 import BeautifulSoup

def main():
    url = "http://baike.baidu.com/view/284853.htm"
    response = urllib.request.urlopen(url)
    html = response.read()
    soup = BeautifulSoup(html, "html.parser")
   
    for each in soup.find_all(href=re.compile("view")):
        print(each.text, "->", ''.join(["http://baike.baidu.com", each["href"]]))

if __name__ == "__main__":
    main()

xiaosi4081

校外也要读研 发表于 2021-6-18 22:36
import urllib.request
import re
from bs4 import BeautifulSoup

你这想找的是啥？

suchocolate

1. from urllib import request
   
2. import re
   
3. from bs4 import BeautifulSoup
   
4. 
   
5. 
   
6. def main():
   
7.     url = "http://baike.baidu.com/view/284853.htm"
   
8.     headers = {'User-Agent': 'Firefox'}   # 得改header防反扒
   
9.     req = request.Request(url, headers=headers)
   
10.     r = request.urlopen(req)
    
11.     html = r.read().decode('utf-8')
    
12.     soup = BeautifulSoup(html, "html.parser")
    
13.     for each in soup.find_all(href=re.compile("view")):
    
14.         print(each.text, "->", ''.join(["http://baike.baidu.com", each["href"]]))
    
15. 
    
16. 
    
17. if __name__ == "__main__":
    
18.     main()

复制代码