MR #153 grew from ingesting just Census Dataset groups metadata into ingesting groups, geographies, tags, variables, and core dataset metadata. I implemented several strategies (e.g., downloading and ingesting the full dataset catalog, walking and scraping the entire FTP-like interface, and finally implementing dataset-specific metadata and data scrapers/API-callers), and now there's a lot of redundant code.
Clean up the metadata+data pulling taskflow, and remove unused implementations.
MR #153 grew from ingesting just Census Dataset groups metadata into ingesting groups, geographies, tags, variables, and core dataset metadata. I implemented several strategies (e.g., downloading and ingesting the full dataset catalog, walking and scraping the entire FTP-like interface, and finally implementing dataset-specific metadata and data scrapers/API-callers), and now there's a lot of redundant code.
Clean up the metadata+data pulling taskflow, and remove unused implementations.