A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
2.71k
stars
350
forks
source link
[Feature]: NativeLibraryConfig.WithLibrary availablility in Dotnet Standard 2.1 (For compatibility with Unity3D) #960
Open
ltmx opened 1 month ago
Background & Description
This feature would make loading backends much easier in Unity.
API & Usage
Same as for Dotnet 6
How to implement
Add a section that compiles for Dotnet Standard 2.1 (current version only compiles for Dotnet 6 or greater via compiler arguments) : https://github.com/SciSharp/LLamaSharp/blob/master/LLama/Native/Load/NativeLibraryConfig.cs