open-mmlab / mmselfsup

OpenMMLab Self-Supervised Learning Toolbox and Benchmark
https://mmselfsup.readthedocs.io/en/latest/
Apache License 2.0
3.14k stars 429 forks source link

mmselfsup 的数据集只能是图片数据集吗, train pipeline 中只看到 LoadImageFromFile #727

Open SG-XM opened 1 year ago

SG-XM commented 1 year ago

我如果有其他形式的数据集想用来做 ssl, 以及自定义 pretext task, 要如何适配数据集(比如最经典的IRIS)? 还是说现在的代码设计架构完全不支持其它类型的数据集呢? 感谢您的回答,祝工作顺利,身体健康!

mm-assistant[bot] commented 1 year ago

We recommend using English or English & Chinese for issues so that we could have broader discussion.

YuanLiuuuuuu commented 1 year ago

Currently, we only support ssl for images.

YuanLiuuuuuu commented 1 year ago

Or videos, please refer to MaskFeat

SG-XM commented 1 year ago

我的数据集中的元素就是一个13维的向量,在mmselfsup的基础上是否有可能跳过LoadImageFromFile 来自定义自己的加载方式呢?还是说即使自定义了自己的加载方式,后面也会遇到非常多的问题

YuanLiuuuuuu commented 1 year ago

In addition to redefining another LoadxxxFromFile, similar to LoadImageFromFile, to load your custom data, you should also make some customized changes to PackSelfSupInputs, SelfSupDataPreprocessor, and the interfaces of the algorithm you use. Thanks!