Add benchmark script to webUI

intel-analytics / text-generation-webui

A Gradio Web UI for running local LLM on Intel GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max) using IPEX-LLM.

GNU Affero General Public License v3.0

14 stars 8 forks source link

Add benchmark script to webUI #14

Open chtanch opened 6 months ago

chtanch commented 6 months ago

New UI

Terminal output

First line 'Output generated in .. ' is from original source code and printed regardless of benchmark toggle. Second line 'Latency 1st/2nd+ .. ' is printed only if benchmark is toggled on.