Allows for completely custom LLM support via REST API
Example config:
{
"api_config": {
"url": "https://api.example.com/v1/chat/completions", // Replace with your API endpoint
"headers": {
"Content-Type": "application/json",
"Authorization": "Bearer 123124534545634", // Replace with your API key
"Accept": "application/json"
},
"data_template": {
"model": "example-model",
"messages": "<PROMPT>" // This is where the prompt will be inserted
}
}
}
Allows for completely custom LLM support via REST API
Example config:
Can easily add support for ChatGPT, Claude, etc.