I noticed that the after asking it usually give answer very approx 2min so I was thinking to play around other LLM Infrence Model like Groq to make the output real-time.
Does this project active and how I can contribute to this with other open source models
I have setup the project on Google colab
It would be great if you can guide me in the process @gcapuzzi
I noticed that the after asking it usually give answer very approx 2min so I was thinking to play around other LLM Infrence Model like Groq to make the output real-time.
Does this project active and how I can contribute to this with other open source models
I have setup the project on Google colab
It would be great if you can guide me in the process @gcapuzzi