Open prabirshrestha opened 3 months ago
Would be great to add support for https://github.com/EricLBuehler/mistral.rs. This allows the inference to be embedded in the binary.
Would be great to add support for https://github.com/EricLBuehler/mistral.rs. This allows the inference to be embedded in the binary.