mjlading / flashlearn

A learning webapp for students
https://flashlearn.no
2 stars 0 forks source link

Should the LLM used for flashcard generation be 3rd party or self hosted #44

Open Gunnar-Solli-Olsen opened 7 months ago

Gunnar-Solli-Olsen commented 7 months ago

This is primarily an economic question, does the cost of tokens exceed the cost of self hosting?

The pricing will change over time, and closed source models do not allow running a local instance (gpt 4.0, gemini)

We should investigate our expendetures per user. (Even if it's only for documentation purposes)