codeproject / CodeProject.AI-Server

CodeProject.AI Server is a self contained service that software developers can include in, and distribute with, their applications in order to augment their apps with the power of AI.
Other
605 stars 141 forks source link

CUDA processing is not working on Linux Docker #8

Closed elad-bar closed 1 year ago

elad-bar commented 1 year ago

Tried to load the image of GPU, modules are being loaded throughout the GPU (nvidia-smi command), while processing is being done on the CPU.

elad-bar commented 1 year ago

According to Vision/modulesettings.docker.json, face recognition processing does not support CUDA:

{
  "Modules": {
    "FaceProcessing": {
      "Runtime": "python38",
      "EnvironmentVariables": {
        "USE_CUDA": "false"
      }
    },
    "SceneClassification": {
      "Runtime": "python38"
    },
    "VisionObjectDetection": {
      "Runtime": "python38"
    }
  }
}