|
发表于 2020-7-30 10:17:08
|
显示全部楼层
可以用正则提取汉字:
- from bs4 import BeautifulSoup
- import requests
- from pyquery import PyQuery as pq
- import json
- import re
- url = 'https://www.zhihu.com/question/404413681/answer/1354281798'
- headers = {
- 'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 '
- '(KHTML, like Gecko) Chrome/83.0.4103.106 Safari/537.36'
- }
- html = requests.get(url, headers=headers).text
- soup = BeautifulSoup(html, 'lxml')
- doc = pq(html)
- items = doc('#js-initialData').items()
- for item in items:
- print(re.findall(r'[\u4e00-\u9fa5]+', item.text()))
复制代码 |
|