search

PeoplePlusAI / sunva-ai

SUNVA AI: Seamless conversation loop for the deaf
13 stars 3 forks source link

Core: Indic language LLM router #60

Open maximaminima opened 2 months ago

maximaminima commented 2 months ago

Test sarvam 2b llm for hindi, kannada, malayalam and other languages Think about a router to route to particular llm based on language this is needed for better summarisation for diff indian languages than just using gpt4o as on now.

maximaminima commented 2 months ago

Note there is no instruction tuned release by Sarvam. Test and check status of other indian languages LLMs

cc @gksoriginals @souseb555

gksoriginals commented 2 months ago

So basically right now we are using LLMs for two things. One for intelligently simplifying a sentence without losing context when the text is detected as a casual one and if the text is a context rich one on a scientific or technical topic highlight important words instead of simplification.

  1. You can find the logic and prompts for the above mentioned capabilities in english here

  2. We need to test this for savram and other indic language models. For now maybe lets focus on Hindi and Malayalam.

  3. Also we need to abstract the code so that we can integrate multiple languages and different prompts for different languages.