SageMaker Inference with GPU

Kenza-AI / sagify

LLMs and Machine Learning done easily

https://kenza-ai.github.io/sagify/

MIT License

434 stars 69 forks source link

SageMaker Inference with GPU #147

Open gabriel-fsa opened 1 year ago

gabriel-fsa commented 1 year ago

Is it possible to inference using GPU in Sagemaker with Sagify? I saw in this issue that it is not possible to do local training with GPU. I have this problem, it is not recognizing the GPU and it is using the CPU.