Closed MorganCThomas closed 5 months ago
What are the minimum GPU requirements to run this model?
Is an A100 necessary or can it be run on something with less memory?
For regular inference, a recent consumer-grade NVIDIA GPU should be sufficient. However, if you want to (re)train this type of model from scratch, an A100 GPU might be necessary.
Thanks!
What are the minimum GPU requirements to run this model?
Is an A100 necessary or can it be run on something with less memory?