microsoft / CNTK

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit
https://docs.microsoft.com/cognitive-toolkit/
Other
17.5k stars 4.29k forks source link

GPU Nvidia Quadro 6000 not detected by cntk.all_devices() #2208

Closed manolodepuerto closed 6 years ago

manolodepuerto commented 7 years ago

I have installed an Nvidia Quadro 6000 GPU on a PC with the latest driver updates, and it is not being detected by CNTK. I have installed the precompiled version of CNTK 2.1 for python 3.5 for GPU, installed CUDA and other dependencies.

However, when using cntk.all_devices() I only get 1 device, CPU. Attempting to set the GPU as the default with try_set_default_device() subsequently fails since CNTK is not seeing the GPU. I have tried with CNTK 2.0 as well, updated drivers, reinstalled all dependencies (I reinstalled anaconda3 python and CUDA as well) and still nothing. I have verified that the GPU is working properly.

Thanks in advance for your help.

ebarsoumMS commented 7 years ago

What does NVidia-smi command show?

Anhipa commented 7 years ago

Hello. I am a college of @manolodepuerto. Here is the NVidia-SMI command.

Thanks !

C:\Program Files\NVIDIA Corporation\NVSMI>nvidia-smi.exe -q

==============NVSMI LOG==============

Timestamp                           : Wed Aug 16 11:14:15 2017
Driver Version                      : 377.55

Attached GPUs                       : 1
GPU 0000:04:00.0
    Product Name                    : Quadro 6000
    Product Brand                   : Quadro
    Display Mode                    : Disabled
    Display Active                  : Enabled
    Persistence Mode                : N/A
    Accounting Mode                 : N/A
    Accounting Mode Buffer Size     : N/A
    Driver Model
        Current                     : WDDM
        Pending                     : WDDM
    Serial Number                   : 0322212040375
    GPU UUID                        : GPU-062f9dd5-230b-64ce-f577-02b49ce059e3
    Minor Number                    : N/A
    VBIOS Version                   : 70.00.57.00.03
    MultiGPU Board                  : No
    Board ID                        : 0x400
    GPU Part Number                 : N/A
    Inforom Version
        Image Version               : N/A
        OEM Object                  : 1.0
        ECC Object                  : 1.0
        Power Management Object     : 1.0
    GPU Operation Mode
        Current                     : N/A
        Pending                     : N/A
    GPU Virtualization Mode
        Virtualization mode         : None
    PCI
        Bus                         : 0x04
        Device                      : 0x00
        Domain                      : 0x0000
        Device Id                   : 0x06D810DE
        Bus Id                      : 0000:04:00.0
        Sub System Id               : 0x076F103C
        GPU Link Info
            PCIe Generation
                Max                 : 2
                Current             : 1
            Link Width
                Max                 : 16x
                Current             : 16x
        Bridge Chip
            Type                    : N/A
            Firmware                : N/A
        Replays since reset         : N/A
        Tx Throughput               : N/A
        Rx Throughput               : N/A
    Fan Speed                       : 30 %
    Performance State               : P12
    Clocks Throttle Reasons         : N/A
    FB Memory Usage
        Total                       : 6144 MiB
        Used                        : 65 MiB
        Free                        : 6079 MiB
    BAR1 Memory Usage
        Total                       : N/A
        Used                        : N/A
        Free                        : N/A
    Compute Mode                    : Default
    Utilization
        Gpu                         : 0 %
        Memory                      : 1 %
        Encoder                     : N/A
        Decoder                     : N/A
    Encoder Stats
        Active Sessions             : 0
        Average FPS                 : 0
        Average Latency             : 0
    Ecc Mode
        Current                     : Disabled
        Pending                     : Disabled
    ECC Errors
        Volatile
            Single Bit
                Device Memory       : N/A
                Register File       : N/A
                L1 Cache            : N/A
                L2 Cache            : N/A
                Texture Memory      : N/A
                Texture Shared      : N/A
                Total               : N/A
            Double Bit
                Device Memory       : N/A
                Register File       : N/A
                L1 Cache            : N/A
                L2 Cache            : N/A
                Texture Memory      : N/A
                Texture Shared      : N/A
                Total               : N/A
        Aggregate
            Single Bit
                Device Memory       : N/A
                Register File       : N/A
                L1 Cache            : N/A
                L2 Cache            : N/A
                Texture Memory      : N/A
                Texture Shared      : N/A
                Total               : N/A
            Double Bit
                Device Memory       : N/A
                Register File       : N/A
                L1 Cache            : N/A
                L2 Cache            : N/A
                Texture Memory      : N/A
                Texture Shared      : N/A
                Total               : N/A
    Retired Pages
        Single Bit ECC              : N/A
        Double Bit ECC              : N/A
        Pending                     : N/A
    Temperature
        GPU Current Temp            : 69 C
        GPU Shutdown Temp           : N/A
        GPU Slowdown Temp           : N/A
    Power Readings
        Power Management            : N/A
        Power Draw                  : N/A
        Power Limit                 : N/A
        Default Power Limit         : N/A
        Enforced Power Limit        : N/A
        Min Power Limit             : N/A
        Max Power Limit             : N/A
    Clocks
        Graphics                    : 50 MHz
        SM                          : 101 MHz
        Memory                      : 135 MHz
        Video                       : 135 MHz
    Applications Clocks
        Graphics                    : N/A
        Memory                      : N/A
    Default Applications Clocks
        Graphics                    : N/A
        Memory                      : N/A
    Max Clocks
        Graphics                    : 573 MHz
        SM                          : 1147 MHz
        Memory                      : 1494 MHz
        Video                       : 540 MHz
    Clock Policy
        Auto Boost                  : N/A
        Auto Boost Default          : N/A
    Processes                       : None