linto-ai / linto-stt

An automatic speech recognition API
GNU Affero General Public License v3.0
45 stars 14 forks source link

Healthcheck broken for streaming #47

Open damienlaine opened 4 days ago

damienlaine commented 4 days ago

Description

When using SERVICE_MODE=websocket, the current implementation does not properly handle health checks, leading healthcheck fail streak in orchestrated deployments.


Current Behavior


Questions to Address

  1. Failback Implementation: Should we default to SERVICE_MODE=http and use it in combination with ENABLE_STREAMING to achieve streaming?
  2. Potential Drawbacks:
    • Could this approach introduce additional latency, system load, or other unexpected issues?

Expected Outcome