search

NVIDIA / ChatRTX

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM
Other
2.76k stars 339 forks source link

Suggestion: print tokens/s and other stats like lm studio #80

Open oscarbg opened 4 months ago

oscarbg commented 4 months ago

Image: IMG_0345