issues
search
philschmid
/
deep-learning-pytorch-huggingface
MIT License
618
stars
143
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
OOM error in FSDP QLORA setup
#60
ss8319
opened
2 hours ago
0
added spec example
#59
philschmid
closed
2 weeks ago
0
Regarding the OOM issues with fine-tuning Flan-T5-xl
#58
Alsodream
opened
1 month ago
0
Update instruction-tune-llama-2-int4.ipynb
#57
Rishav-hub
closed
1 month ago
1
Quantization question:
#56
aptum11
opened
2 months ago
0
Not able to run training/fsdp-qlora-distributed-llama3.ipynb
#55
aasthavar
closed
2 months ago
7
St
#54
philschmid
closed
3 months ago
0
Clean up some typos; simplify some code; update some comments
#53
tomaarsen
closed
3 months ago
0
Deprecation warnings.
#52
hohoCode
opened
3 months ago
0
Fine-tune-llm-in-2024-with-trl.ipynb not producing the outputs
#51
scigeek72
opened
3 months ago
0
Fsdp qlora
#50
philschmid
closed
4 months ago
0
Out of Memory: Cannot reproduce T5-XXL run on 8xA10G.
#49
slai-natanijel
opened
5 months ago
3
What's the use of "messages" in dpo step?
#48
katopz
opened
5 months ago
0
question about DeepSpeedPeftCallback
#47
mickeysun0104
opened
6 months ago
0
Gemma
#46
philschmid
closed
6 months ago
0
Re. fine-tune-llms-in-2024-with-trl.ipynb
#45
andysingal
opened
6 months ago
1
Dpo
#44
philschmid
closed
6 months ago
0
Target modules all-linear not found in the base model.
#43
kassemsabeh
closed
7 months ago
6
Commit Version Bug Fix
#42
YanSte
closed
7 months ago
1
Trl
#41
philschmid
closed
7 months ago
0
flash attention error on instruction tune llama-2 tutorial on Sagemaker notebook
#40
matthewchung74
opened
10 months ago
2
Precision Issue
#39
zihaohe123
opened
11 months ago
4
Falcon-180B "forward() got an unexpected keyword argument 'position_ids'"
#38
aittalam
opened
11 months ago
0
Does this work for Llama2 - Fine-tune Falcon 180B with DeepSpeed ZeRO, LoRA & Flash Attention?
#37
ibicdev
opened
11 months ago
11
Ds lora
#36
philschmid
closed
11 months ago
0
Instruction tuning of LLama2 is significantly slower compared to documented 3 hours fine-tuning time on A10G.
#35
mlscientist2
opened
11 months ago
1
Compute metrics while using SFT trainer
#34
shubhamagarwal92
opened
11 months ago
1
Cannot load tokenizer for llama2
#33
smreddy05
closed
11 months ago
1
LLama 2 Flash Attention Patch Not Working For 70B
#32
mallorbc
opened
12 months ago
6
Gptq
#31
philschmid
closed
1 year ago
0
Fix Flash Attention forward for Llama-2 70b
#30
davidmrau
closed
1 year ago
8
Is the DataCollator necessary in peft-flan-t5-int8-summarization.ipynb ?
#29
brooksbp
opened
1 year ago
0
question about the llama instruction code
#28
yeontaek
closed
1 year ago
8
improvements
#27
philschmid
closed
1 year ago
0
Llama patch for FlashAttention support fails with use_cache
#26
qmdnls
opened
1 year ago
2
How to create a json file for create_flan_t5_cnn_dataset.py
#25
andysingal
opened
1 year ago
1
gcc/cuda used for training
#24
danyaljj
opened
1 year ago
1
fix
#23
philschmid
closed
1 year ago
0
Flash attention
#22
philschmid
closed
1 year ago
4
Falcon int4
#21
philschmid
closed
1 year ago
0
added container image for training
#20
philschmid
closed
1 year ago
0
CPU offload when not using offload deepspeed config file
#19
siddharthvaria
opened
1 year ago
3
Error when training peft model example
#18
Tachyon5
opened
1 year ago
6
Colab notebook fails
#17
TzurV
closed
1 year ago
1
CUDA OOM error while saving the model
#16
aasthavar
closed
1 year ago
10
Does deepspeed partition the model to multi GPUs?
#15
vikki7777
opened
1 year ago
4
ValueError
#14
Martok10
opened
1 year ago
4
Inference on CNN validation set takes 2+ hours on p4dn.24xlarge machine with 8 A100s, 40GB each
#13
sverneka
opened
1 year ago
5
FLAN-T5 XXL using DeepSpeed fits well for training but gives OOM error for inference.
#12
irshadbhat
opened
1 year ago
2
Sample inference script for FLAN-T5 XXL using DeepSpeed & Hugging Face.
#11
irshadbhat
closed
1 year ago
7
Next