feat: track performance

atoma-network / atoma-proxy

Atoma's proxy service repository

Apache License 2.0

0 stars 0 forks source link

Closed Cifko closed 1 week ago

Cifko commented 1 week ago

Track node performance

throughput, what was the time from request send to receiving result
latency (only for streaming) what was the time from the request send to first token to arrive