openclimatefix / dagster-dags

Dags for running jobs on Leonardo
2 stars 0 forks source link

fix(gfs): Modify gfs asset to use subprocess pipes client #117

Closed devsjc closed 5 months ago

devsjc commented 5 months ago

Currently docker is not able to allocate memory to run containers. In the meantime while I fix it, use suprocess to run python gfs downloads.