Database and crawler code clean up

fcavallarin / htcap

htcap is a web application scanner able to crawl single page application (SPA) recursively by intercepting ajax calls and DOM changes.

GNU General Public License v2.0

610 stars 114 forks source link

Database and crawler code clean up #17

Closed GuilloOme closed 7 years ago

GuilloOme commented 7 years ago

I did some clean up and add comment and unittest before starting on adding #16 feature. I propose here the refactoring so the next PR will be shorter… ;)

unittest database.py at 88% (only the print(exception) are not tested)
fix almost all the PEP8 error
comment and document the main piece of code
make a distinction between private and/or static method

(I recommend you to review it commit per commit instead of "in one big chuck")

GuilloOme commented 7 years ago

I have the rest of the fix for #16 waiting this one to be merge. I will propose a PR as soon as this one is merge. see: https://github.com/delvelabs/htcap/tree/db-reuse-feature Thanks,