search

fmperf-project / fmperf

Cloud Native Benchmarking of Foundation Models
Apache License 2.0
13 stars 9 forks source link

Could we package fmperf more like a Python-library? #29

Open tdoublep opened 1 month ago

tdoublep commented 1 month ago

Docker-image based deployment is essential for running in k8s/openshift, but increasing I find myself also using fmperf for running benchmarks on development machines. It might also be useful if we could use fmperf more like a Python library (e.g., without needing to use docker at all).

I think we should explore this a little bit more. We could even potentially publish wheels to PyPI (e.g. pip install fmperf)

GhaziSyed commented 1 month ago

@tdoublep I am taking a look into this.