Add flan support and retokenize support.

RUCAIBox / LLMBox

A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.

MIT License

566 stars 74 forks source link

Closed timturing closed 2 months ago