ml-explore / mlx-examples

Examples in the MLX framework
MIT License
5.5k stars 791 forks source link

[Model Request] Add support for IBM's Granite model #815

Closed sealad886 closed 3 weeks ago

sealad886 commented 4 weeks ago

ibm-granite/granite-34b-code-instruct is a new model that is relatively light weight for how high it's punching. It's a great code helper, and it works well in niche areas. I'd love to be able to finetune it with MLX.

awni commented 4 weeks ago

That model type is already supported. Did you try it and it didn't work?

awni commented 3 weeks ago

Let us know if that doesn't work for you.