search

IBM / Dromedary

Dromedary: towards helpful, ethical and reliable LLMs.
GNU General Public License v3.0
1.11k stars 86 forks source link

How many GPUs were used for training? #7

Closed TheBloke closed 1 year ago

TheBloke commented 1 year ago

Thank you very much for all the info provided.

But the one thing I couldn't seem to find is details of how many GPUs (and what GPUs) you used to run finetune.py?

It'd be great to see the deepspeed/torchrun command you executed to do the training.

TheBloke commented 1 year ago

So sorry, as soon as I opened this I looked at closed issues and realised it was already answered!