search

PaulMcInnis / JobFunnel

Scrape job websites into a single spreadsheet with no duplicates.
MIT License
1.85k stars 215 forks source link

Bad Status #33

Closed studentbrad closed 5 years ago

studentbrad commented 5 years ago

When changing the status to applied and rerunning JobFunnel master_list.csv has no fields! Yikes! Every time running JubFunnel thereafter will result in an empty list of jobs. If you delete master_list.csv a new list will be created next time running JobFunnel but the previous jobs are gone.

We need two things:

  1. To fix this issue.
  2. Make a way to dump existing pickles to form master_list.csv in case this ever happens again.

I think by default I will have the software search for existing pickles by changing: load_pickle(self, args) to load_pickles(self, args). This way, all pickles are important and not just today's pickle.

studentbrad commented 5 years ago

When using a .csv file editor, the application will reformat the .csv file. JobFunnel chokes on the new .csv formatting and fails. Many editors will delimit by a tab or space by default and upon saving replaces these with a ,.