Arquisoft / wiq_en1a

Wiq_en1a a web application by HappySw. Come and try our questions
http://158.179.217.182:3000
2 stars 0 forks source link

llama3 slow generation #134

Open adriiglz opened 5 months ago

adriiglz commented 5 months ago

I've been trying to integrate llama3 messages after game ending for giving users feedback in some original way, but text generation is very slow and makes user experience a bit bad. I presume in our ARM VM it would run even slower. If anybody has any idea to make llama3 run faster I will continue developing this feature, but I can't integrate it until then.

andrrsin commented 5 months ago

I believe we should focus on other important things, It's a good idea but we are issing key features of the project