-
Hello,
I've been using this package for a short while now to try to do cross modal retrieval. However, for some reason my weights are always zero or near zero (e.g. -0.001), no matter what combinat…
-
https://www.imageclef.org/photodata
-
## Problem statement
1. CLIP variants의 이미지와 텍스트 사이의 관계 학습은 텍스트의 각 토큰들과 이미지 패치의 관계에 대해 학습하기에는 학습과 추론 시 효율성이 떨어진다 -> finer-level alignment할 수 있는 방법을 찾아보자
2. 이미지 패치와 텍스트 토큰 간의 attention 이용하는 기존 연구의 약점 …
-
Hello,
May I ask what GPU does your model need to run? Is a single 3090 OK?
-
Hi,
Great work! I read the paper and it extends the number of modalities from 6 in ImageBind to 12 without paired data.
I'm wondering with Meta-Transformer if the network can also perform a simila…
-
Hello,
I'm trying to learn multi-modal embedding architecture and was confused about how the existing implementations evaluate the model. I appreciate if you could clarify that to me.
As far as I …
-
Can you provide a copy of the MS-COO dataset? I downloaded the COCO dataset in DAEH mentioned in this article, but found that it does not match the dataset structure in this code.
-
请问,论文中使用到的NUS-WIDE-10K的处理后的数据集可以提供一下吗?现在不容易找到NUS-WIDE-10K的数据。
-
The feature extraction tutorial is available for only *images* https://vissl.ai/tutorials/Feature_Extraction. Can we extract features for **videos**? I would love to contribute and send PR if necessar…
-
Hello, thank you for your code!
I am having a look at the way that the mAP is being calculated, in the following function:
https://github.com/LongLong-Jing/Cross-Modal-Center-Loss/blob/5025837561a…