Added sampling tests - Githubissues

SciSharp / LLamaSharp

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

https://scisharp.github.io/LLamaSharp

MIT License

2.7k stars 349 forks source link

Added sampling tests #984

Closed Lyrcaxis closed 1 week ago

Lyrcaxis commented 1 week ago

Added some tests for testing various levels of the sampling pipeline -- from low-level logits to high-level SafeLLamaSamplerChainHandle. Includes both unbatched and batched sampling.

martindevans commented 1 week ago

Thanks again!