issues
search
Xirider
/
finetune-gpt2xl
Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed
MIT License
427
stars
73
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Branch2
#25
pruksmhc
closed
1 year ago
0
TypeError: __init__() got an unexpected keyword argument 'no_args_is_help'
#24
SeekPoint
opened
1 year ago
0
IndexError: index out of bounds
#23
GreenTeaBD
closed
1 year ago
1
fine tuning GPT-J 6B?
#22
silvacarl2
opened
1 year ago
1
Using [text,labels] instead of just [text] in Datasets
#21
imthebilliejoe
opened
1 year ago
1
subprocess.CalledProcessError:
#20
Dhanachandra
opened
2 years ago
1
Out of memory with RTX3090
#19
PyxAI
opened
2 years ago
4
separate examples for finetuning
#18
CupOfGeo
closed
2 years ago
1
Feeding the model separate examples instead of one continuous block of text
#17
CupOfGeo
opened
2 years ago
1
AttributeError: 'DeepSpeedCPUAdam' object has no attribute 'ds_opt_adam'
#16
remotejob
opened
3 years ago
8
Gpt-neo inference with Deepspeed: IndexError: Dimension out of range
#15
kingpalethe
closed
3 years ago
3
New issue with Pandas
#14
barakw2021
opened
3 years ago
0
Crashes with new Transformers version
#13
barakw2021
closed
3 years ago
1
Can't change BOS token or EOS token for GPT Neo
#12
mallorbc
closed
3 years ago
3
Ideal number of epochs? Number of examples meaning?
#11
mallorbc
closed
3 years ago
1
Freezing at "Using /home/user/.cache/torch_extensions as PyTorch extensions root..."
#10
mallorbc
closed
3 years ago
4
Resume from checkpoint
#9
ArturTanona
closed
3 years ago
2
TypeError: unsupported operand type(s) for -: 'float' and 'str' on AWS g4dn.12xlarge
#8
sibeshkar
closed
3 years ago
0
Errors while trying to train with two GPUs
#7
barakw2021
closed
3 years ago
4
Unable to proceed, no GPU resources available
#6
bpm246
closed
3 years ago
3
Multiple entries csv
#5
kikirizki
closed
3 years ago
1
Training on a larger dataset fails due to memory issues on faster GPUs
#4
jonnyplatt
closed
3 years ago
3
Suspected optimizer issue causing crashes
#3
kinoc
closed
3 years ago
1
Exception: Installed CUDA version 11.0 does not match the version torch was compiled with 11.1 [SOLUTION]
#1
CupOfGeo
closed
3 years ago
2