Closed diegolascasas closed 9 months ago
Add MoE and Pipelining support
Update readme
Update requirements
Add faster loading
Make sliding window optional and add rope_theta with smart default
Add MoE and Pipelining support
Update readme
Update requirements
Add faster loading
Make sliding window optional and add rope_theta with smart default