issues
search
princeton-nlp
/
LLM-Shearing
[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
https://arxiv.org/abs/2310.06694
MIT License
533
stars
39
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
NotImplementedError: offload_to_cpu=True and NO_SHARD is not supported yet
#23
Longyichen
closed
9 months ago
3
How much compute will this take?
#22
fakerybakery
closed
8 months ago
7
sample data generate name
#21
sunzhe09
closed
8 months ago
6
Question about ComposerMosaicLlama.forward
#20
hanlinxuy
closed
9 months ago
4
Composer Model Transform problems encountered when shearing Pythia 1.4b
#19
Longyichen
closed
9 months ago
2
How can I use it on multiple nodes without slurm?
#18
wang99711123
closed
9 months ago
1
Use without flash-attn?
#17
fakerybakery
closed
9 months ago
3
FileNotFoundError: No such file or directory:"save_hf_to_composer"
#16
sunzhe09
closed
9 months ago
1
AssertionError: Currently only supports dynamic loading from each domain for once.
#15
Longyichen
closed
9 months ago
17
Sample.py error when sampling stackexchage
#14
Longyichen
closed
9 months ago
4
Scaling Law for predicted loss
#13
AlpinDale
closed
8 months ago
4
Small typo on Table 2
#12
lxww302
closed
10 months ago
1
Dynamic Batch Loading v.s. Domain Reweighting
#11
lxww302
closed
8 months ago
1
Can Sheared-LLaMA beat OpenLLaMA v2 significantly with the same amount of compute ?
#10
lxww302
closed
8 months ago
2
LanguageCrossEntropy logs nan when bash pruning.sh
#9
Longyichen
closed
9 months ago
7
License is missing
#8
casper-hansen
closed
10 months ago
1
TypeError: load_data() missing 1 required positional argument: 'tokenizer_name'
#7
hanlinxuy
closed
10 months ago
3
Can you provide script without using slurm or sbatch?
#6
hanlinxuy
closed
10 months ago
2
Update README.md
#5
eltociear
closed
10 months ago
1
Why update model parameters when training pruning parameters?
#4
KaihuaTang
closed
10 months ago
1
Repeated assignment in l0_module.py
#3
Longyichen
closed
10 months ago
2
Any updates on the code?
#2
AlpinDale
closed
10 months ago
5
Missing Reference
#1
wutaiqiang
closed
10 months ago
5
Previous