search

cve-search / vulnerability-lookup

Vulnerability-Lookup facilitates quick correlation of vulnerabilities from various sources, independent of vulnerability IDs, and streamlines the management of Coordinated Vulnerability Disclosure (CVD).
https://vulnerability.circl.lu
GNU Affero General Public License v3.0
136 stars 16 forks source link

NVD importer crashes on 502 Bad Gateway #29

Closed svniedner closed 7 months ago

svniedner commented 7 months ago

When importing NVD feeds, I encountered the follwowing error. It appears the NVD importer has stopped working after this. The URL is working (checked using curl), an API key is specified. The 502 appears to be a hickup on the NVD side. Expected behaviour: The importer should wait for a moment and then retry.

Log files:

2024-04-09 16:25:48,441 NVDFetcher ERROR:Something went terribly wrong in NVDFetcher. Traceback (most recent call last): File "/vulnerability-lookup/vulnerabilitylookup/default/abstractmanager.py", line 146, in run self._to_run_forever() File "/vulnerability-lookup/bin/nvd_fetcher.py", line 22, in _to_run_forever self.fetcher.update() File "/vulnerability-lookup/vulnerabilitylookup/feeders/nvd.py", line 49, in update r.raise_for_status() File "/root/.cache/pypoetry/virtualenvs/vulnerabilitylookup-K_6IT42j-py3.11/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 502 Server Error: Bad Gateway for url: https://services.nvd.nist.gov/rest/json/cves/2.0/?startIndex=33500&resultsPerPage=500

Rafiot commented 7 months ago

Yeah, that's the NVD feed, it randomly fails. Give it a bit and it will fix itself. The script will re-run later and it will hopefully work.

svniedner commented 7 months ago

OK, thanks for the info! Any way to start the importer manually? Best, sven

Rafiot commented 7 months ago

yes, you can do poetry run nvd_importer. But normally, the service is still running and will re-try in 1h.