search

OptimalScale / LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
https://optimalscale.github.io/LMFlow/
Apache License 2.0
8.11k stars 819 forks source link

[Model] hf model modification and inheritance change #852

Closed wheresmyhair closed 2 weeks ago

wheresmyhair commented 2 weeks ago

Description

Move some methods in hf_decoder_model and hf_text_regression to hf_model_mixin

Pipeline Tests

  1. Full-Finetune ft

  2. LISA lisa

  3. LoRA LoRA

  4. QLoRA qlora