search

SciSharp / LLamaSharp

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
https://scisharp.github.io/LLamaSharp
MIT License
2.65k stars 345 forks source link

Using this repo in unity 3d. #482

Open sania96 opened 9 months ago

sania96 commented 9 months ago

Hi, how can i use this repo in unity 3d? to make a chatbot in unity 3d. can you give me some guidelines.

Xsanf commented 9 months ago

Use example https://github.com/eublefar/LLAMASharpUnityDemo NuGet version 0.8.1 works with it. Select the appropriate backend for GPU support. Perhaps 0.9.1 LLamaSharp will work. but only if you do not install SemanticKernel and KernelMemory. I haven't checked how the calls have changed, I may have to change the example a little based on the latest examples from LLamaSharp.