search

openclimatefix / nowcasting_dataset

Prepare batches of data for training machine learning solar electricity nowcasting data
https://nowcasting-dataset.readthedocs.io/en/stable/
MIT License
25 stars 6 forks source link

AYSNC load bug #674

Open peterdudfield opened 2 years ago

peterdudfield commented 2 years ago

Describe the bug Bug when loading the same file with async, from gcsfs

To Reproduce do with async, and loading the same file from gcsfs.

TODO minimum example

  1. load a file to gcsfs
  2. make async function to load that file
  3. run two functions at the same time using aysnc
JackKelly commented 2 years ago

this might be relevant? https://stackoverflow.com/a/67287158/732596