Use of open-source model

[Bachstelze]

Is it possible to use LLaMa as vector embeddings?

[BohuTANG]

Sure, But still trying to figure out what the API of LLaMa is, some docs about it? Now, Databend uses the OpenAI API doc here:

https://platform.openai.com/docs/guides/embeddings/what-are-embeddings

[Bachstelze]

LLaMA are Open and Efficient Foundation Language Models. Though I think that the decoder architecture isn't suitable for information retrival. Open ai uses probably encoder Models like sentence Bert or sentence similarity Models.