91视频网站爬虫工具，可以批量或单独爬取视频。 不带参数运行程序时，进入日常爬取模式，固定每天8点爬取24小时内发布的30个评分最高的视频，评分由关键字、视频时长、作者分三项评分组成(score下的两个txt定义了关键词评分和作者评分，分数范围[-∞，100])。每周六9点会爬取本周评分最高的30个最热视频并把当周的视频整理到一个文件夹下。程序有去重机制不会重复下载同一个视频。
202
stars
36
forks
source link
ERROR: could not unmarshal event: unknown PrivateNetworkRequestPolicy value #18
Open
shiguanglaoxi opened 1 year ago
D:\91porn_spider>spider91 -c -u "http://91porn.com/v.php?category=rf&viewtype=basic&page=2" -p "http://127.0.0.1:8000" http://91porn.com/v.php?category=rf&viewtype=basic&page=2 Crawl done! DownladMany:len([]*VideoInfo)=24 2022/11/30 17:40:20 ERROR: could not unmarshal event: unknown PrivateNetworkRequestPolicy value
DlAddr https://www.91porn.com/view_video.php?viewkey=438060464 context deadline exceeded [付费] [原创] DlAddr not set!
D:\91porn_spider>spider91 -c -u "http://91porn.com/view_video.php?viewkey=8cd0148b3fe08d4a4c2f" -p "http://127.0.0.1:8000" context deadline exceeded