issues
search
arcee-ai
/
fastmlx
FastMLX is a high performance production ready API to host MLX models.
https://arcee-ai.github.io/fastmlx/
Other
227
stars
25
forks
source link
Setup FastMLX
#1
Closed
Blaizzy
closed
4 months ago
Blaizzy
commented
4 months ago
Add support for Vision LM
Add support for LM
Add tests
Todo
[x] Add streaming
[ ] Add token usage
[ ] Add loading state endpoint
Todo