Open grammophone opened 5 hours ago
The null refererence exception is caused by the InferenceParams.SamplingPipeline
being null. It's meant to default to the DefaultSamplingPipeline
if you don't set it, so that looks like a bug in the LLamaInteractExecutor
.
Description
I just upgraded the NuGet packages from 0.16 to 0.18. CPU backend. The simple test console program still compiled but it no longer runs. Inside
ChatSession.ChatAsync
I get the exception:Reproduction Steps
Environment & Configuration
Known Workarounds
No response