2DegreesInvesting / tiltDataPipelines

MIT License
0 stars 0 forks source link

Normalized ldm v1 #122

Closed ysherstyuk closed 7 months ago

ysherstyuk commented 7 months ago

Hi @SKruthoff,

My PR is still work in progress, but I thought would already be good to provide some feedback on the initial steps. You can find some small changes to the schemas and implementation of the raw layer and data model layer for ecoInvent data. You can also check the tables that are generated on Databricks. I'm still trying to generate other tables that are specified in processing.py, but running into some issues. Also I have not yet restructured tables.py table as we discussed, only the preprocessing for now.