search

philschmid / deep-learning-pytorch-huggingface

MIT License
580 stars 138 forks source link

gcc/cuda used for training #24

Open danyaljj opened 11 months ago

danyaljj commented 11 months ago

In your tutorial on llama-2 (below) would you mind sharing what versions of gcc and cuda you're using?

https://github.com/philschmid/deep-learning-pytorch-huggingface/blob/main/training/instruction-tune-llama-2-int4.ipynb

philschmid commented 11 months ago

Sure. 

>> nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Jun__8_16:49:14_PDT_2022
Cuda compilation tools, release 11.7, V11.7.99
Build cuda_11.7.r11.7/compiler.31442593_0

and 

>> gcc --version
gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0
Copyright (C) 2019 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

I am using this AMI Deep Learning AMI GPU PyTorch 1.13.1 (Ubuntu 20.04) 20230309 with ami id ami-078afdc6b93b6177f in us-east-1