casual-simulation / casualos

Casual Open Simulation for the Web
https://ab1.bot
MIT License
48 stars 9 forks source link

Add the ability to give custom token modifier costs per AI model #393

Open KallynGowdy opened 6 months ago

KallynGowdy commented 6 months ago

Currently, all AI models (chat, & image) count tokens at the same rate. e.g. 1 token for say gpt-4 is the same as 1 token for gpt-3.5-turbo. Ideally, we would be able to set a custom token ratio per model so that we can charge more for some models or even discount the cost of some models.