search

nat / openplayground

An LLM playground you can run on your laptop
MIT License
6.17k stars 478 forks source link

Added time to first token as requested in the README #110

Open ckgresla opened 9 months ago

ckgresla commented 9 months ago

I added the functionality to measure when we receive the first chars response from models and then display the time to that moment in either milliseconds (ms) or seconds (s)