lihuithe / podlm-public

419 stars 46 forks source link

fetch_url_content 函数无法成功获取youtube内容 #3

Open weilichao opened 2 weeks ago

weilichao commented 2 weeks ago

反复测试,response.text拿到数据后,BeautifulSoup解析,只能获取几十个字符,是否已经更新了代码?

weilichao commented 2 weeks ago

这是我测试"https://www.youtube.com/watch?v=bq1Plo2RhYI&t=1598s" 后得到content.txt内容

"How We Built Replit Agent: Fireside Chat with Harrison Chase & Michele Catasta - YouTube簡介新聞中心版權聯絡我們創作者刊登廣告開發人員條款私隱政策及安全YouTube 的運作方式測試新功能© 2024 Google LLC"

lihuithe commented 1 week ago

现在请求网页用户py自带的库,建议把采集器做一下封装以适配各种网站的采集需求