search

riccardomusmeci / mlx-llm

Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.
Other
312 stars 27 forks source link

Phi-3.5-MoE-instruct #24

Closed ayttop closed 3 weeks ago

ayttop commented 3 weeks ago

Is microsoft/Phi-3.5-MoE-instruct supported?

how convert Phi-3.5-MoE-instruct to gguf

riccardomusmeci commented 3 weeks ago

Currently MoE models are not supported. Same for gguf.