search

mlc-ai / mlc-llm

Universal LLM Deployment Engine with ML Compilation
https://llm.mlc.ai/
Apache License 2.0
19.23k stars 1.58k forks source link

[Question] Which models do you recommend for compiling on Mac Intel chip, metal gpu? #2999

Open RINO-GAELICO opened 3 weeks ago

RINO-GAELICO commented 3 weeks ago

❓ General Questions

So far I was only able to compile togethercomputer/RedPajama-INCITE-Chat-3B-v1 on my machine.

What other models are feasible for this type of machine?