Netflix-Skunkworks / Scumblr

Web framework that allows performing periodic syncs of data sources and performing analysis on the identified results
Apache License 2.0
2.64k stars 318 forks source link

Bugfix/vuln helper #217

Closed sbehrens closed 7 years ago

sbehrens commented 7 years ago

When two urls are identified that have different parameter values, Scumblr creates a new vulnerability instead of deduplicating. This is because the old comparison just looked at an exact match of the URLs. This PR parses the URL and plucks out every query parameter. Regardless of parameter order or parameter values, it will deduplicate if all params, path, domain match.

Tests were added to assert this works correctly. This should help dedupliate vulns from scan engines that use nonces in parameter values.