This is a much smaller update that the last one. Only notable changes are:
Some changes in the fill-in-middle (FIM) token functions (no change to C# API)
New FIM tokens exposed, not sure what these are for so no useful comments, if anyone knows a tip would be appreciated!
Removed softmax sampler. It's deprecated upstream, so it's best to remove it quickly on our end since that's a new API no one will be depending on yet.
Updated to 958367bf530d943a902afa1ce1c342476098576b, built with https://github.com/SciSharp/LLamaSharp/actions/runs/11509292954
This is a much smaller update that the last one. Only notable changes are:
Testing: