PKU-Alignment / align-anything

Align Anything: Training All-modality Model with Feedback
https://align-anything.readthedocs.io
Apache License 2.0
260 stars 47 forks source link

[Feature Request] : Need to support LoRA and QLoRA #17

Closed yongzhemiaolegemi closed 4 months ago

yongzhemiaolegemi commented 4 months ago

Required prerequisites

Motivation

Solution

No response

Alternatives

No response

Additional context

No response

yongzhemiaolegemi commented 4 months ago

16 LoRA and QLoRA supported in this pr

Gaiejj commented 4 months ago

Feel free to ask @yongzhemiaolegemi if you encounter any issues!