search

SoftwareDesignLab / nvip-crawler

Crawler project for National Vulnerability Integlligence Platform
MIT License
0 stars 0 forks source link

PyPA Parser Bugs #152

Closed memeeerit closed 1 year ago

memeeerit commented 1 year ago

Investigate if the PYPA parser is still pulling all the PYSEC files in the repo.

Fix potential sources of nullpointer errors e.g. this.published = data.get("published").toString(), but not every file has a published key.

Some more error logs from the PyPA parser

2023-09-21 03:56:39,486 INFO  [main] github.PyPAGithubScraper (PyPAGithubScraper.java:128) - Pulled git repo at: https://github.com/pypa/advisory-database/ to: pypa-repo
2023-09-21 03:56:39,486 INFO  [main] github.PyPAGithubScraper (PyPAGithubScraper.java:63) - Extracting CVEs from /vulns dir...
2023-09-21 03:56:41,595 WARN  [main] github.PyPAGithubScraper (PyPAGithubScraper.java:91) - Unable to parse PYSEC-2023-174.yaml: null
2023-09-21 03:56:42,412 WARN  [main] github.PyPAGithubScraper (PyPAGithubScraper.java:91) - Unable to parse PYSEC-2023-175.yaml: null