search

winstxnhdw / nllb-api

A performant high-throughput CPU-based API for Meta's No Language Left Behind (NLLB) using CTranslate2, hosted on Hugging Face Spaces.
https://huggingface.co/spaces/winstxnhdw/nllb-api
96 stars 18 forks source link

Add docker compose & small stress test #221

Closed JulianKropp closed 2 months ago

winstxnhdw commented 2 months ago

Hey, I appreciate the effort in making this PR but I don’t think I’ll be going through with this.

Instead of using compose, we use a Makefile instead. As for the stress test, there are a bunch of existing load-testers that will do a better job at stressing and visualising the results.