Uniform I/O between transformers, tools and dashboard - Githubissues

CivicActions / edscrapers

US Department of Education Data Scraping Kit; see https://us-ed-scraping.ckan.io/dataset

GNU Affero General Public License v3.0

15 stars 9 forks source link

Uniform I/O between transformers, tools and dashboard #88

Open nightsh opened 4 years ago

nightsh commented 4 years ago

What we have now:

Target:

Tasks:

dump everything in XLSX files
load everything from XLSX sheets instead of individual files
generate one file per transformer (except datajson)
use the new files in dashboard

Acceptance criteria:

[ ] All transformers dump in XLSX
[ ] The name parameter will generate a new sheet, instead of a new file
[ ] Everything works as expected, with the new data files

Note: The deprecated compare tool will be ignored for now, as well as its output. It will be subject to another task related to stats.