Add an /embed API (POST) endpoint to embed text to vector representation.
We currently use OpenAI's text-embedding-ada-002 with vectors of dimensionality 1536 (This must be configured in the init.sql file when created vector embedding tables).
NOTE: The embedding model can be swapped with a local Open-Source model in the future depending on the available infrastructure.
Description
Add an /embed API (POST) endpoint to embed text to vector representation.
We currently use OpenAI's text-embedding-ada-002 with vectors of dimensionality 1536 (This must be configured in the init.sql file when created vector embedding tables).
NOTE: The embedding model can be swapped with a local Open-Source model in the future depending on the available infrastructure.