search

filipw / strathweb-phi-engine

A cross platform library with C#/Swift/Kotlin/Python bindings for running Phi-3 inference
MIT License
11 stars 1 forks source link

try to call the on_inference_token callback for last token #18

Closed filipw closed 2 months ago

filipw commented 2 months ago

Fixes #17

The last token was not available via callbacks (only in the full result). Additionally fixed the sample which called the old Shell script for Swift