PaulMcInnis / JobFunnel

Scrape job websites into a single spreadsheet with no duplicates.
MIT License
1.81k stars 212 forks source link

Testing for parser.py and fixed proxy problem #66

Closed thebigG closed 4 years ago

thebigG commented 4 years ago

Pull Request Template

Hello everyone! Hope you are all safe and healthy! Below is my testing process along with some changes I made.

Description

I followed the same approach as before: I test each unit in parser.py and then test the module as a whole at the end. As I was testing I noticed that the proxy option does not actually work. It turns out the problem was in the parsing of the --proxy option. Specifically, I had to change update_yaml in parser.py. Nothing big, just an if statement that checks if the key k does not exist in the config dictionary. I also removed None as a "type" in the proxy item in CONFIG_TYPES. This gave me all sorts of problems when trying to fix the proxy problem as in Python type(None) == None is false. Which I know can be confusing because one may easily assume that is the same as type(1) == int but it isn't. None is a special type where there exists only one instance of NoneType. It also turns out we really don't need NoneType as a type for proxy.

List any developers that will be affected or those who you had merge conflicts with.

Context of change

Please add options that are relevant and mark any boxes that apply.

Type of change

Please mark any boxes that apply.

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration.

Checklist:

Please mark any boxes that have been completed.