issues
search
Guitaricet
/
relora
Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
https://arxiv.org/abs/2307.05695
Apache License 2.0
436
stars
39
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Code bugs
#18
itongggg
opened
2 weeks ago
4
Training scripts to reproduce the results
#17
JinYujie99
opened
6 months ago
0
Do not merge, used only to indicate the diff between bugfix and main codebase
#16
Guitaricet
opened
7 months ago
0
RFC - multinode training
#15
omri123
closed
6 months ago
1
Support llama-2 series model?
#14
skykiseki
opened
1 year ago
0
Training scripts
#13
harshaUwm163
opened
1 year ago
0
Able to further pretrain llama2?
#12
mooncui
closed
1 year ago
2
Usage Consultation
#11
datalee
closed
1 year ago
1
Inf checks warning on optimizer
#10
ElleLeonne
closed
1 year ago
2
实际任务相关的问题
#9
wanghao-007
closed
1 year ago
2
About ReLoRA usage
#8
haofanwang
closed
1 year ago
2
can be used in stable diffusion?
#7
henbucuoshanghai
closed
1 year ago
1
llama_2 notebook example?
#6
thistleknot
closed
1 year ago
2
Is it possible to use qlora with relora?
#5
tiendung
closed
1 year ago
1
versions of the dependencies
#4
vorobyov01
closed
1 year ago
2
Inquiry About Minimum VRAM Requirement for ReLoRA Model Training
#3
Njasa2k
closed
1 year ago
2
Once this model is trained, how should I infer ? Is there an example script?
#2
ScottishFold007
closed
1 year ago
2
Does this model continue to improve in large scale regime?
#1
DaehanKim
closed
1 year ago
3