search

aidatatools / ollama-benchmark

LLM Benchmark for Throughput via Ollama (Local LLMs)
https://llm.aidatatools.com/
MIT License
64 stars 13 forks source link

can we release it as pypi package? #2

Closed larrycai closed 3 months ago

larrycai commented 3 months ago

So far, it needs to download or install via github.

Is it possible to install using pip directly like

$ pip install ollama-benchmark

or llm-benchmark

chuangtc commented 3 months ago

A website was created to explain your need. https://llm.aidatatools.com/

pip install llm-benchmark==0.3.8
llm_benchmark run