Edgov parser phase3

[osahon-okungbowa]

TASKS TACKLED

• fixed error in crawler by setting allowed_domains
• improved content outpur from parser by removing trailing white space characters from resource name and descriptions
• ensure all datasets have a title and description
• ensure resources have a name and description

[osahon-okungbowa]

@nightsh submitted the updated crawler as additional commit. in addition to tasks tackled, latest commit does the following

Updated Commit

• stopped using allowed_regex in edgov crawler.
• edgov crawler now uses the allowed_domains class property and the deny_domains parameter within the rules/Rule property
• created a new helper function in scrapers.base.helpers called retrieve_crawlers_allowed_domains. This function does all the heavy-lifting to ensure only the allowed_domains specified by edgov crawler are actually crawled. Helper function is called by deny_domains parameter