danielmiessler / fabric

fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.
https://danielmiessler.com/p/fabric-origin-story
MIT License
25.77k stars 2.74k forks source link

[Feature request]: Integrate with Venice AI using their API #610

Open SimonSomlai opened 5 months ago

SimonSomlai commented 5 months ago

What do you need?

Venice doesn't give API access (yet). But this issue can stay on the backlog until that time ^^. People who use fabric tend to be the privacy-oriented, self-hosting types.

https://venice.ai/chat

timothyjoh commented 5 months ago

Had a look at the communication between the UI and the backend, and it looks pretty simple, but uses Clerk for Auth and such. Would be a good addition when API keys are available, but these models should be available via projects like Ollama as well, right now it is just

https://huggingface.co/NousResearch/Hermes-2-Theta-Llama-3-8B and https://huggingface.co/Dogge/llama-3-70B-uncensored