octoml / mlc-llm

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
https://mlc.ai/mlc-llm
Apache License 2.0
5 stars 8 forks source link

Clean-up and keep the exact copy of FP8 flow #256

Closed sunggg closed 7 months ago