search

OpenGVLab / OmniQuant

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
MIT License
689 stars 53 forks source link

[datautils] fix c4 dataset #54

Closed xingchensong closed 8 months ago

xingchensong commented 8 months ago

There is a breaking change in c4 dataset, fix it according to:

xingchensong commented 8 months ago

cc @ChenMnZ

ChenMnZ commented 8 months ago

Thanks for your contribution~