uas-at-ucla / suas-23-24

Software/Vision operations for UAS@UCLA, 2023-2024. For a list of tasks, visit https://github.com/orgs/uas-at-ucla/projects/1
3 stars 0 forks source link

Prometheus and Grafana Vision Server Visualization #39

Closed nathanchan631 closed 1 year ago

nathanchan631 commented 1 year ago

Expose vision metrics on /metrics endpoint, which are scraped by Prometheus and displayed in a Grafana dashboard. Docker Loki Driver plugin (installed with make build) sends logs to Loki, which are also displayed on Grafana. All services run in containers started by docker compose, with Prometheus exposed on port 9090, Loki on port 3100, and Grafana on port 3000. Note that Prometheus requests to /metrics are not logged by gunicorn.

Smaller updates: Only use one server worker to eliminate race conditions, update POST odlc request to unpack telemetry data.

TODO: Send telemetry to Prometheus, likely from flight.