可以在fiftyone中实现文搜图跨模态检索吗

OFA-Sys / Chinese-CLIP

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

MIT License

4.32k stars 448 forks source link

Open seasnakes opened 3 weeks ago

seasnakes commented 3 weeks ago

fiftyone中集成了 transformers库，通过fiftyone的brain组件可以用各种clip来抽取数据集的embedding 进而实现跨模态检索，但在测试中发现只能通过英文检索，中文查询没法识别

8bc715f4-b8ce-4af2-b53a-46de976f697d