SoftwareDesignLab / nvip-crawler

Crawler project for National Vulnerability Integlligence Platform
MIT License
0 stars 0 forks source link

Job Streaming for PNE/Patchfinder #168

Closed dylan-mulligan closed 11 months ago

dylan-mulligan commented 1 year ago

Instead of one large batch of ids, support single ids (keep batch functionality if possible) to allow job streaming. Completed jobs should insert their data into the database immediately after completion, resulting in nearly lossless runtime interruption of service.