search

JAM-Solutionss / SnapScrib

MIT License
1 stars 0 forks source link

Summarizer research #4

Closed arvedb closed 2 months ago

arvedb commented 3 months ago

We need to research which LLM or library can be used for summarizing the transcription.

mirixy commented 3 months ago

For that I would argue that llama3-70b is sufficient enough. Also provided by groq. The Rate Limits should be fine. It would be a fast service that way and be more fun to use than running locally.