Evaluate sentence-transformer or Ada

[KazChe]

duplicate

[KazChe]

• use openai embeddings - for sake of agility of the project
• note that this is a pre-trained text embedding model for semantic similarity searches, clustering etc. NOT for conversational interactions.
• openai github repo https://github.com/openai/openai-node
• if hybrid approach: look into DistilGPT-2 (Hugging Face) , gpt2 etc

[KazChe]

will use Vertex AI embedding models