iterative / datachain

AI-data warehouse to enrich, transform and analyze data from cloud storages
https://docs.datachain.ai
Apache License 2.0
942 stars 55 forks source link

Handle huggingface images/audio objects as files #369

Closed dberenbaum closed 1 month ago

dberenbaum commented 2 months ago

I think it also makes sense to revisit caching and storing objects in a follow-up. The image and audio objects are heavy and the approach in this PR is suboptimal:

Originally posted by @dberenbaum in https://github.com/iterative/datachain/issues/311#issuecomment-2313106909

dberenbaum commented 2 months ago

Part of #236

dberenbaum commented 1 month ago

See #396