issues
search
RUCAIBox
/
LLMBox
A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.
MIT License
620
stars
79
forks
source link
Auto batch size for HF model
#212
Closed
huyiwen
closed
6 months ago
huyiwen
commented
6 months ago
Support auto_batch_size for HF model when prefix caching is disabled
Update README