The service needs to store and query the list of discovered URLs with low latency to handle a large number of crawled pages per scan request. A new DB layer is added to solve this problem.
Pull request checklist
[ ] Addresses an existing issue: Fixes #0000
[x] Added relevant unit test for your changes. (yarn test)
[ ] Verified code coverage for the changes made. Check coverage report at: <rootDir>/test-results/unit/coverage
Details
Motivation
The service needs to store and query the list of discovered URLs with low latency to handle a large number of crawled pages per scan request. A new DB layer is added to solve this problem.
Pull request checklist
yarn test)<rootDir>/test-results/unit/coverageyarn precheckin)