Open NirantK opened 1 day ago
Hi, you need to edit the downloaded model config.json file and replace Qwen2VLForConditionalGeneration
with Qwen2VLForEmbeddingGeneration
.
The local_dir
should be 'models/mcdse-2b-v1' and consequentially the sed command will be the following:
sed -i -e 's/Qwen2VLForConditionalGeneration/Qwen2VLForEmbeddingGeneration/g' /content/models/mcdse-2b-v1/config.json
Hey, I'm trying setting up a Colab demo with MCDSE but getting something obvious wrong: https://colab.research.google.com/drive/1aEgITiGDgKb3RSaKHcNjdHa67HVkibZc?usp=sharing
Would appreciate a second pair of eyes 👀