search

ai-cfia / fertiscan-backend

Fertiscan backend
MIT License
2 stars 0 forks source link

Improve the speed of the Azure OpenAI endpoint. #29

Closed snakedye closed 4 months ago

snakedye commented 4 months ago

The OpenAI Azure endpoint is slow for both GPT-3.5 and GPT-4 (5 min).

Acceptance Criteria:

snakedye commented 4 months ago

Solution found in ollama branch.

GET /analyze take about 30 seconds to respond in our few tests.