libffcv / ffcv

FFCV: Fast Forward Computer Vision (and other ML workloads!)
https://ffcv.io
Apache License 2.0
2.79k stars 180 forks source link

how to update existing beton files with new fields? #325

Open yashkant opened 1 year ago

yashkant commented 1 year ago

Hi there!

I love this project, and have been replacing all my dataset loaders with it!

I have some .beton files of my dataset that I need to update with new fields (keeping the original intact).

I was wondering what is the recommended way to do this?

The alternative would be to read through the full dataset, and generate new one with updated fields. However, is there an inplace way of doing this?

Appreciate your help!