jozu-ai / kitops

Tools for easing the handoff between AI/ML and App/SRE teams.
https://KitOps.ml
Apache License 2.0
339 stars 34 forks source link

Update LlamaCPP? #424

Closed bmicklea closed 1 month ago

bmicklea commented 2 months ago

Describe the bug When I unpack the old Phi3 ModelKit from GHCR and run kit dev start . everything works. When I unpack the newer Phi3 ModelKit from Jozu Hub the Dev command fails.

Version kit version: 0.3.0-1653de5

bmicklea commented 1 month ago

This wasn't the source of the issue we were seeing with some of the Jozu-built ModelKits. Closing this as not an issue.