issues
search
AnswerDotAI
/
fsdp_qlora
Training LLMs with QLoRA + FSDP
Apache License 2.0
1.38k
stars
185
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
NCCL issue training with two GPUs
#22
deepankarsharma
opened
6 months ago
2
Drop trailing slash from last line in command prompts for easier copy…
#21
deepankarsharma
closed
6 months ago
1
fix typo in readme
#20
danromuald
closed
6 months ago
2
Training from e
#19
maderix
closed
6 months ago
1
[`Docs`] Update bnb installation guidelines for users that want to install bnb from source
#18
younesbelkada
closed
6 months ago
4
Add arguments for reentrant_checkpointing & wandb
#17
warner-benjamin
closed
6 months ago
0
Add Apache Open-Source License
#16
warner-benjamin
closed
6 months ago
0
Release
#15
johnowhitaker
closed
6 months ago
0
Add HQQ support and prepare for release
#14
warner-benjamin
closed
6 months ago
0
Update README.md
#13
johnowhitaker
closed
6 months ago
0
Scaling experiments
#12
KeremTurgutlu
closed
6 months ago
1
License
#11
fakerybakery
closed
6 months ago
0
Sfttrainer equivalent
#10
johnowhitaker
closed
7 months ago
1
Finetuning benchmarking experiments
#9
KeremTurgutlu
closed
7 months ago
1
correct logged lost
#8
johnowhitaker
closed
7 months ago
0
Add guanaco dataset
#7
johnowhitaker
closed
7 months ago
0
Add `no_sync` support, fix gradient accumulation, and logging and argument improvements
#6
warner-benjamin
closed
7 months ago
1
Refactor, add Doc Strings, and add Type Hints for code readability
#5
warner-benjamin
closed
7 months ago
1
Low Memory works with QLoRA
#4
warner-benjamin
closed
7 months ago
0
Ft enhancements
#3
KeremTurgutlu
closed
7 months ago
0
add lr sched
#2
johnowhitaker
closed
8 months ago
0
Ft enhancements
#1
johnowhitaker
closed
8 months ago
0
Previous