Open MasterJH5574 opened 9 months ago
This issue tracks the support of RoPE scaling, one important configurable parameter adopted by many new models, in MLC LLM.
Hope somebody much smarter than me can help tackle this =)
Rope scaling support is now added to llama 3.1
Overview
This issue tracks the support of RoPE scaling, one important configurable parameter adopted by many new models, in MLC LLM.
Action Items
Links to Related Issues and PRs