issues
search
Blaizzy
/
fastmlx
FastMLX is a high performance production ready API to host MLX models.
Other
159
stars
12
forks
source link
Setup FastMLX
#1
Closed
Blaizzy
closed
2 months ago
Blaizzy
commented
2 months ago
Add support for Vision LM
Add support for LM
Add tests
Todo
[x] Add streaming
[ ] Add token usage
[ ] Add loading state endpoint
Todo