search

petteriTeikari / minivess_mlops

Charissa Poon, Petteri Teikari et al. (2023): "A dataset of rodent cerebrovasculature from in vivo multiphoton fluorescence microscopy imaging", Scientific Data 10, 141 doi: 10.1038/s41597-023-02048-8
http://doi.org/10.1038/s41597-023-02048-8
2 stars 0 forks source link

DVC (Pythonic fetch with shared cache) #1

Open petteriTeikari opened 11 months ago

petteriTeikari commented 11 months ago

dvc pull bash command works just fine with the shared cache, but the Pythonic .get() does not behave similarly. It creates duplicates of the data needlessly wasting disk space https://github.com/petteriTeikari/minivess_mlops/blob/6f1c44670aa213b61863cefee990b6a030f0e768/src/datasets/dvc_utils.py#L57

dagshub[bot] commented 11 months ago

Join the discussion on DagsHub!