microsoft / LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs
https://aka.ms/GeneralAI
MIT License
3.39k stars 253 forks source link

Update lm_datasets.py for uint32 bin-file #203

Closed QuickSolverDab closed 2 months ago

QuickSolverDab commented 2 months ago

extend for the models that use uint32 bin-file