search

Blaizzy / fastmlx

FastMLX is a high performance production ready API to host MLX models.
Other
159 stars 12 forks source link

Integrate mlx-hub like functionality? #28

Open stewartugelow opened 3 weeks ago

stewartugelow commented 3 weeks ago

I've been thinking about the benefits of having some sort of polling mechanism of available HF mlx models and then saw this on X:

https://github.com/g-aggarwal/mlx-hub

Blaizzy commented 3 weeks ago

Thanks @stewartugelow, that's a great suggestion!

I already had something like that planned here #24.

stewartugelow commented 2 weeks ago

Might be a good opportunity to tackle https://github.com/Blaizzy/fastmlx/issues/10 as well?

I assume the logic would be: get supported model types from latest version of mlx/mlx-lm, pull those from HF, throw exceptions for everything else?