issues
search
codeforIATI
/
iati-tables
https://iati-tables.codeforiati.org
MIT License
1
stars
0
forks
source link
Upgrade SQLAlchemy, add more type hints, minor restructure
#44
Closed
tillywoodfield
closed
4 days ago
tillywoodfield
commented
2 weeks ago
No functionality changes
Upgrade to SQLAlchemy 2, and fix errors and deprecation warnings
Add more type hints throughout
Minor restructure (which involves renaming and splitting out a couple of functions) to clarify the main steps of the pipeline:
extract
- fetch data from registry
load
- load XML files into database
process_registry
- transform data in the database into relational tables
export_all
and
upload_all
- as before, export tables to various formats
extract- fetch data from registryload- load XML files into databaseprocess_registry- transform data in the database into relational tablesexport_allandupload_all- as before, export tables to various formats