search

RUCAIBox / LLMBox

A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.
MIT License
566 stars 74 forks source link

[refactor] accelerate KATE: repeatedly loading model #261

Closed huyiwen closed 2 months ago

huyiwen commented 2 months ago