RUCAIBox / LLMBox

A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.
MIT License
620 stars 79 forks source link

Auto batch size for HF model #212

Closed huyiwen closed 6 months ago

huyiwen commented 6 months ago