Closed hgcdanniel closed 4 months ago
How could I use my own SFT model or local hugging face model
Hi @hgcdanniel. Please take a look at the LLM section in the README. You'll see there's a link to a LiteLLM page demonstrating how to get set up with HuggingFace and the like.
How could I use my own SFT model or local hugging face model