search

richardvanorton / scammerlocker

Open-source tool to (legally) take down scam domains
https://scammerlocker.vercel.app
GNU General Public License v3.0
61 stars 1 forks source link

Feature request: Optional OpenAI dependency #2

Closed TechnologyClassroom closed 3 months ago

TechnologyClassroom commented 3 months ago

Self-hosted LLM technology has come a long way. Have you looked into replacing OpenAI with one of the local alternatives?

richardvanorton commented 3 months ago

The industry standard, even with open-source projects tends to lean towards cloud AI unless they are processing a huge amount of requests. I'm using Vercel AI SDK and you could switch to an alternative model or provider, just not a self-hosted version. It won't be efficient for a small project like this to have a self-hosted LLM when costs are very low for AI.