NVD importer crashes on 502 Bad Gateway

[svniedner]

When importing NVD feeds, I encountered the follwowing error. It appears the NVD importer has stopped working after this. The URL is working (checked using curl), an API key is specified. The 502 appears to be a hickup on the NVD side. Expected behaviour: The importer should wait for a moment and then retry.

Log files:

2024-04-09 16:25:48,441 NVDFetcher ERROR:Something went terribly wrong in NVDFetcher. Traceback (most recent call last): File "/vulnerability-lookup/vulnerabilitylookup/default/abstractmanager.py", line 146, in run self._to_run_forever() File "/vulnerability-lookup/bin/nvd_fetcher.py", line 22, in _to_run_forever self.fetcher.update() File "/vulnerability-lookup/vulnerabilitylookup/feeders/nvd.py", line 49, in update r.raise_for_status() File "/root/.cache/pypoetry/virtualenvs/vulnerabilitylookup-K_6IT42j-py3.11/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 502 Server Error: Bad Gateway for url: https://services.nvd.nist.gov/rest/json/cves/2.0/?startIndex=33500&resultsPerPage=500

[Rafiot]

Yeah, that's the NVD feed, it randomly fails. Give it a bit and it will fix itself. The script will re-run later and it will hopefully work.

[svniedner]

OK, thanks for the info! Any way to start the importer manually? Best, sven

[Rafiot]

yes, you can do poetry run nvd_importer. But normally, the service is still running and will re-try in 1h.