microsoft / LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs
https://aka.ms/GeneralAI
MIT License
3.71k stars 283 forks source link

Update lm_datasets.py for uint32 bin-file #203

Closed QuickSolverDab closed 7 months ago

QuickSolverDab commented 7 months ago

extend for the models that use uint32 bin-file