mckaywrigley / chatbot-ui

Come join the best place on the internet to learn AI skills. Use code "chatbotui" for an extra 20% off.
https://JoinTakeoff.com
MIT License
28.87k stars 8.04k forks source link

Advice: Customize for a single FT model #1647

Open wmodes opened 7 months ago

wmodes commented 7 months ago

Not an actual issue, but a broad question about customization. Probably not at all what you are excited to talk about.

I am currently serving a custom model through my own homebuilt UI (https://bot.wmod.es), but am considering switching to chatbot-ui. What do you suggest is the most elegant way to tailor the app to serve a single fine-tuned model? I've been staring at and experimenting with various hacks.

I'm trying not to make too drastic changes because I want to still be able to pull updates from the upstream repo without a freeway pileup of conflicts.

tysonvolte commented 7 months ago

There's an unused "sharing" flag on each of the custom models/assistants I've been using to set master models. Superusers can see and edit the models directly but regular users can just use the models. It's a bit custom but it's definitely doable. To hide the extra functionality you'd probably just want to add logic so that only superusers get to see those features etc.