search

SoftwareDesignLab / nvip-crawler

Crawler project for National Vulnerability Integlligence Platform
MIT License
0 stars 0 forks source link

Patchfinder NullPointerException on valid GitHub page #165

Closed dylan-mulligan closed 1 year ago

dylan-mulligan commented 1 year ago

The PatchUrlFinder should visit the original link shown in the error below, then proceed to its /commits endpoint to scrape commits. This repo has only 2 commits, so it is fair to say that it is an edge case.

Update: Larger error log reveals that this occurs primarily on repos with a very low number of commits (likely <34, which is the max # per page on github)

2023-10-09 16:41:08,403 WARN [Thread-0] patches.PatchUrlFinder (PatchUrlFinder.java:356) - Failed to validate/verify URL https://www.github.com/XPlatform-Consulting/adobe_media_encoder: java.lang.NullPointerException 2023-10-09 16:41:08,902 WARN [Thread-0] patches.PatchUrlFinder (PatchUrlFinder.java:356) - Failed to validate/verify URL https://www.github.com/MSUDenverSystemsEngineering/Adobe-Media-Encoder: java.lang.NullPointerException 2023-10-09 16:41:08,903 WARN [Thread-0] patches.PatchUrlFinder (PatchUrlFinder.java:356) - Failed to validate/verify URL https://www.github.com/tweeter-ops/adobe-media-encoder: java.lang.NullPointerException 2023-10-09 16:41:09,987 WARN [Thread-0] patches.PatchUrlFinder (PatchUrlFinder.java:356) - Failed to validate/verify URL https://www.github.com/josemar-asouza/ruckus-zonedirector-user-mngr: java.lang.NullPointerException 2023-10-09 16:42:15,325 WARN [Thread-0] patches.PatchUrlFinder (PatchUrlFinder.java:356) - Failed to validate/verify URL https://www.github.com/gurayturan/BilyonerSelenium4Project: java.lang.NullPointerException 2023-10-09 16:42:15,325 WARN [Thread-0] patches.PatchUrlFinder (PatchUrlFinder.java:356) - Failed to validate/verify URL https://www.github.com/urensel/_bilyonerCaseJava: java.lang.NullPointerException 2023-10-09 16:42:15,326 WARN [Thread-0] patches.PatchUrlFinder (PatchUrlFinder.java:356) - Failed to validate/verify URL https://www.github.com/mehmeterdemcakir/BilyonerAssignment: java.lang.NullPointerException 2023-10-09 16:42:15,326 WARN [Thread-0] patches.PatchUrlFinder (PatchUrlFinder.java:356) - Failed to validate/verify URL https://www.github.com/ozlemtoru/bilyonerPM: java.lang.NullPointerException