SciSharp / LLamaSharp

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
https://scisharp.github.io/LLamaSharp
MIT License
2.71k stars 350 forks source link

[Feature]: NativeLibraryConfig.WithLibrary availablility in Dotnet Standard 2.1 (For compatibility with Unity3D) #960

Open ltmx opened 1 month ago

ltmx commented 1 month ago

Background & Description

This feature would make loading backends much easier in Unity.

API & Usage

Same as for Dotnet 6

How to implement

Add a section that compiles for Dotnet Standard 2.1 (current version only compiles for Dotnet 6 or greater via compiler arguments) : https://github.com/SciSharp/LLamaSharp/blob/master/LLama/Native/Load/NativeLibraryConfig.cs