omriel1 / llm2vec

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'
https://mcgill-nlp.github.io/llm2vec/
MIT License
0 stars 0 forks source link

Further steps #5

Open omriel1 opened 20 hours ago

omriel1 commented 20 hours ago

Try Yams' Peleg model as the base model: https://huggingface.co/yam-peleg/Hebrew-Mistral-7B

omriel1 commented 20 hours ago

Check how much data was used for the MNTP training