search

Unity-Technologies / barracuda-release

Other
564 stars 76 forks source link

Challenge: Make Baracuda work with Lllama #318

Closed elephantpanda closed 1 year ago

elephantpanda commented 1 year ago

If you would like to put Baracuda to an ultimate test,

why not try and see if you can get Llama (Meta's language model) to work with it!

The smallest is the 7B model which is about 13GB of weights!

This would be a good test of efficiency, speed, and test of working with large models.

Large language models are all the rage these days, and incorporating them with the 3D abilities of Unity would be amazing to create AI avatars.

AlexRibard commented 1 year ago

I'd recommend trying out Sentis (Barracuda refactor update). Sentis loads and runs all sorts of LLMs no problem (modulo your hardware is good enough)