bosun-ai / swiftide

Fast, streaming indexing and query library for AI (RAG) applications, written in Rust
https://swiftide.rs
MIT License
77 stars 5 forks source link

HuggingFace models support (mistralrs) #66

Open timonv opened 2 months ago

timonv commented 2 months ago

Recently https://github.com/EricLBuehler/mistral.rs released, a really nice solution to, besides mistral, add support for a lot of huggingface models.

By implementing SimplePrompt, existing transformers that prompt should be able to use it right away.

timonv commented 1 month ago

Errors currently, parked for now