Closed jiqing-feng closed 2 months ago
Fix nf4 memory issue when using state_dict().
Still has memory issue when loading nf4 model.
Fix nf4 memory issue when using state_dict().
Still has memory issue when loading nf4 model.