search

Dan-wanna-M / formatron

Formatron empowers everyone to control the format of language models' output with minimal overhead.
MIT License
163 stars 6 forks source link

Support MLX for Mac #24

Open remichu-ai opened 2 days ago

remichu-ai commented 2 days ago

Hi, would like to ask if there is plan to support mlx inference engine.

It is the current fastest engine for mac os and i dont think any of the existing other library that support it for format constraints yet.

Dan-wanna-M commented 2 days ago

The main blocker is that I do not have one apple silicon computer, which means I cannot test my integration. That said, I can definitely make a branch of experimental feature(s) when I have more time. I am happy to accept PR as well.@remichu-ai