search

ASSERT-KTH / elle-elle-aime

Automatic Repair Framework with LLMs ❤️
https://repairbench.github.io/
3 stars 0 forks source link

inference server and endpoints for elle-elle-aime #43

Open monperrus opened 1 year ago

monperrus commented 1 year ago

A Triton inference server might be useful for the open-source models

https://github.com/triton-inference-server

monperrus commented 1 year ago

inference server by huggingface https://github.com/huggingface/text-generation-inference

we may get an instance soon with StarCoder

monperrus commented 3 months ago

@GGmorello has set up RepairLLama over HuggingFace Spaces thanks to our zero-gpus account

monperrus commented 3 months ago

@fredbonux is able to use Mixtral and LLama over groq for free, see https://www.groq.com