astronomer / ask-astro

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
https://ask.astronomer.io/
Apache License 2.0
192 stars 47 forks source link

Upgrade Text Emebedding Model to text-embedding-3-small #286

Closed davidgxue closed 7 months ago

davidgxue commented 8 months ago

Please describe the feature you'd like to see Upgrade Text Emebedding Model to text-embedding-3-small from text-embedding-ada-002

Describe the solution you'd like Change the model used in weaviate index to text-embedding-3-small

Are there any alternatives to this feature? text-embedding-3-large can also be explored, but at the moment text-embedding-3-small is the direct replacement of ada-002

Additional context

Acceptance Criteria

davidgxue commented 7 months ago

Testing is blocked until I get access to Weaviate cloud cluster to upgrade