issues
search
transmissions11
/
bistro
Opinionated GPT implementation and finetuning harness.
Apache License 2.0
5
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
rename min_lr_ratio to final_lr_ratio
#25
transmissions11
opened
3 months ago
0
fused adam / disable foreach?
#24
transmissions11
opened
3 months ago
0
upgrade to torch 2.2, remove advice to install nightly
#23
transmissions11
opened
7 months ago
0
drop_last=True in datamodule
#22
MF-FOOM
closed
3 months ago
0
max_seq_length optimization
#21
transmissions11
opened
9 months ago
0
feat: use commit message for run_name
#20
transmissions11
closed
9 months ago
0
feat: upgrade lit-gpt
#19
MF-FOOM
closed
9 months ago
0
lightning's built in throughput monitor
#18
transmissions11
opened
10 months ago
0
torch.compile
#17
transmissions11
opened
10 months ago
2
Does gradient accumulation need to be hand-written?
#16
charlesfrye
closed
10 months ago
1
throughput monitor
#15
transmissions11
closed
9 months ago
1
install script
#14
transmissions11
closed
10 months ago
0
generation script
#13
transmissions11
opened
11 months ago
1
remove soft prompt logic
#12
transmissions11
closed
11 months ago
0
regression loss tests with pythia / rand weights
#11
transmissions11
opened
11 months ago
1
double batch size during validation
#10
charlesfrye
closed
11 months ago
1
add speed monitor again
#9
transmissions11
closed
11 months ago
1
fsdp is really slow, ddp/deepspeed is not
#8
transmissions11
opened
1 year ago
0
resume
#7
transmissions11
opened
1 year ago
1
Move soft prompting into the model
#6
charlesfrye
closed
11 months ago
1
Refactor to use the regular `lightning.Trainer`
#5
charlesfrye
closed
1 year ago
1
Refactor to use `lightning.LightningDataModule`
#4
charlesfrye
closed
1 year ago
3
Refactor to use `lightning.LightningModule`
#3
charlesfrye
closed
1 year ago
2
adds a "single batch test"
#2
charlesfrye
closed
11 months ago
1
adds missing requirements, notes command for torch 2.1 install
#1
charlesfrye
closed
1 year ago
0