[JIT] Support overriding optimization flags in JIT

mlc-ai / mlc-llm

Universal LLM Deployment Engine with ML Compilation

https://llm.mlc.ai/

Apache License 2.0

19.23k stars 1.58k forks source link

[JIT] Support overriding optimization flags in JIT #3032

Closed MasterJH5574 closed 5 days ago

MasterJH5574 commented 5 days ago

This PR adds the optimiation flags override ("opt") for MLCEngine, chat and serve when running JIT compilation. Prior to this PR, the JIT compilation always uses O2 as the optimization flags.