voxel51 / fiftyone

Refine high-quality datasets and visual AI models
https://fiftyone.ai
Apache License 2.0
8.86k stars 560 forks source link

[FR] Support for using lmdb format files in fiftyone #2293

Closed swatideshpande2228 closed 1 year ago

swatideshpande2228 commented 2 years ago

I am trying to use fiftyone with a dataset in lmdb format (.mdb) and I want to know which class I should extend to add support for it? This database is binary and does not have individual file path entries.

brimoor commented 2 years ago

Hi @swatideshpande2228 👋

FiftyOne is fundamentally designed to have all data stored in MongoDB, which filepaths on disk to media files. It would be a ton of work to write a Dataset subclass that instead pulls data from an lmdb, as the public interface of the SampleCollection class is quite extensive.

You can certainly, however, write an importer that will load your data into FiftyOne. Here's some advice on doing that: https://github.com/voxel51/fiftyone/issues/1636#issuecomment-1064303172

swatideshpande2228 commented 2 years ago

Thanks

swheaton commented 1 year ago

closing as won't do, it should be done with a custom importer