To run GPT-2, the examples directory is missing from the repository

AmiiThinks / benchmarks

Collection of benchmarks written by researchers at Amii

https://amii.ca

1 stars 3 forks source link

To run GPT-2, the examples directory is missing from the repository #9

Open shrutiramesh1988 opened 1 year ago

shrutiramesh1988 commented 1 year ago

rm -r /tmp/test-clm; LOCAL_RANK=0,1,2,3; CUDA_VISIBLE_DEVICES=0,1,2,3 \ python -m torch.distributed.launch --nproc_per_node 4 --use-env examples/pytorch/language-modeling/run_clm.py \ --model_name_or_path gpt2 --dataset_name wikitext --dataset_config_name wikitext-2-raw-v1 \ --do_train --output_dir /tmp/test-clm --per_device_train_batch_size 4 --fp16 --max_steps 200

The examples directory and the benchmarking code is missing for BERT. Only README is present currently.

chenyangh commented 1 year ago

Hi. As pointed out in the README, the code is obtained by git clone git@github.com:huggingface/transformers.git. Sorry if I didn't make it very clear.

shrutiramesh1988 commented 1 year ago

Thank you for the clarification. It ran successfully.