Minimal GPU memory needed to run fine-tuned deepseek-coder-33b-instruct?

bin123apple / Fortran2Cpp

Fortran2Cpp: A new model designed for the Code translation between the Fortran and C++

Apache License 2.0

4 stars 1 forks source link

Closed chunhualiao closed 2 months ago

chunhualiao commented 2 months ago

User may need this information to check if they have enough GPU resources.

bin123apple commented 2 months ago

It is shown in the Hardware requirements parts (We used 6 A100 GPUs with 80GB memory for the training).

chunhualiao commented 2 months ago

I asked for minimal gpu memory for inference.

You respond with the configration for training.

Do you think we are taking about the same thing?

bin123apple commented 2 months ago

For the inference, the information is also shown in the Hardware requirements part (We used 2 A100 GPUs with 80GB memory for the inference.)