search

SciSharp / LLamaSharp

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
https://scisharp.github.io/LLamaSharp
MIT License
2.11k stars 285 forks source link

Slightly Safer Quantize Params #698

Closed martindevans closed 1 month ago

martindevans commented 1 month ago

Modified llama_model_quantize to accept argument by ref instead of pointer. One less unsafe required.