OpenDataScotland / the_od_bods

Collating open data from across Scotland
MIT License
20 stars 18 forks source link

Make pipeline less verbose #253

Open KarenJewell opened 1 year ago

KarenJewell commented 1 year ago

Is your feature request related to a problem? Please describe. Current pipeline is extremely verbose as all the scrapers are doing their own thing. It becomes a bit too much to read when debugging.

Describe the solution you'd like Options:

  1. Switch of all individual print statements
  2. standardise messages at main() level
  3. add parameter to switch on/off verbosity

Describe alternatives you've considered rip it all out and rebuild as modules.

Additional context None.

JackGilmore commented 1 year ago

I did introduce Loguru when I worked on main.py last but didn't really get round to applying it to any other scripts