search

liltom-eth / llama2-webui

Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps.
MIT License
1.96k stars 201 forks source link

[FEATURE] add `--iter` argument for benchmark #33

Closed liltom-eth closed 1 year ago

liltom-eth commented 1 year ago

Running the benchmark a couple of times to take the average results, the default can be set as --iter 1.

jules552 commented 1 year ago

Will try to look at it even if I haven't use python in a while, but it seems I have not the rights to assign myself to this issue

liltom-eth commented 1 year ago

Thanks. Yeah, only the owners can assign issues. This feature is not difficult in python by using a package like argparse.