search

2DegreesInvesting / tiltWorkflows

Make it easy to run tilt workflows
https://2degreesinvesting.github.io/tiltWorkflows/
GNU General Public License v3.0
0 stars 0 forks source link

Providing emission_profile_upstream_product file #113

Open AnneSchoenauer opened 10 months ago

AnneSchoenauer commented 10 months ago

Dear Sven, Could you please provide the emission_profile_upstream_product file in the output table folder that you have created still? I created a ticket for Tilman and me to not forget to try out DataBricks on our own but for now it would be great if you could still create it. Thanks a lot! Best Anne

Tilmon commented 9 months ago

@SKruthoff do you already have an update on this issue? Or will you be able to work on it still this week? Thanks! cc' @AnneSchoenauer

SKruthoff commented 9 months ago

Hi,

I will upload the file just be aware that it is around 60GB.

Tilmon commented 9 months ago

Ufff... In that case, maybe a subset is enough for review. What do you think @AnneSchoenauer ?

AnneSchoenauer commented 9 months ago

Yes maybe right! Maybe you could pick like 100 random companies? the rest is covered by the data quality checks and captured in the dashboard! Thanks @SKruthoff

SKruthoff commented 9 months ago

I can also do that. But I see that we have a meeting next week around using databricks. You could also use that to do some analysis on the full dataset, since the data available in databricks would be that data I am sharing.

Tilmon commented 2 months ago

@AnneSchoenauer this ticket we can close right?