search

iridium-soda / VulnCodeCollector

A lightweight tool designed to automatically crawl CVE-related source code, with the capability to export content in a readable database format(i.e. 多维表格) for applications like Lark or Tencent Docs.
Apache License 2.0
0 stars 0 forks source link

增加重试和复位机制 #5

Open iridium-soda opened 1 week ago

iridium-soda commented 1 week ago

在大量数据当中会不可避免出现各种网络连接问题（429，503，etc.）需要给get函数设置重试，以及数据量过大为避免重复爬取可以跳过已经落库的数据