The main goal of this PR is to migrate the configuration from python imports to .yaml files. This includes the custom configuration (search parameters, mail setup, etc.) as well as the site configurations.
In addition to just achieving this awesome goal some new sites were added, some old were fixed and reactivated.
And because it's a new year I topped that of with a new configuration feature that let's you choose which sites should not be crawled.
If that does not convince you to merge this PR I don't know what will. :)
The main goal of this PR is to migrate the configuration from python imports to .yaml files. This includes the custom configuration (search parameters, mail setup, etc.) as well as the site configurations.
In addition to just achieving this awesome goal some new sites were added, some old were fixed and reactivated.
And because it's a new year I topped that of with a new configuration feature that let's you choose which sites should not be crawled. If that does not convince you to merge this PR I don't know what will. :)