Open BruceJohnJennerLawso opened 7 years ago
Also the manual header fixes for WHA guest teams
Simplest way of doing this is probably to get master as stable as possible, make a branch, and repeatedly scrape the data and test until everything is working in one scrape->run step
This is a big one, almost a mini-project in its own right.
Too many csvs have been hand edited to fix errors or mistakes where the scraper was lacking (ie the manual header row fixes for season, playoffs, the entire csv for the 1918 wanderers, etc.)
Really need to fix this, potentially by doing a full rewrite of both scrapers in beautiful soup, so as to eliminate the hacky workarounds required to deal with empty spaces in tables, etc, etc.