Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback): CUDA Setup failed despite GPU being available. Please run the following command to get more information: python -m bitsandbytes Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

[smillpine]

System Info

System Information

• ComfyUI Version: v0.2.2

• Arguments: E:\ComfyUI\ComfyUI-aki\ComfyUI-aki-v1.3\main.py --auto-launch --preview-method auto --disable-cuda-malloc

• OS: nt

• Python Version: 3.11.6 | packaged by conda-forge | (main, Oct 3 2023, 10:29:11) [MSC v.1935 64 bit (AMD64)]

• Embedded Python: false

• PyTorch Version: 2.3.1+cu118

  Devices

• Name: cuda:0 NVIDIA GeForce RTX 3080 Ti : cudaMallocAsync

  • Type: cuda
  • VRAM Total: 12884246528
  • VRAM Free: 11597250560
  • Torch VRAM Total: 0
  • Torch VRAM Free: 0

Reproduction

ComfyUI Error Report

Error Details

• Node Type: Joy_caption
• Exception Type: RuntimeError

• Exception Message: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):

  CUDA Setup failed despite GPU being available. Please run the following command to get more information:
  
  python -m bitsandbytes
  
  Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
  to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
  and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

  Stack Trace

Expected behavior

ComfyUI Error Report

Error Details

• Node Type: Joy_caption
• Exception Type: RuntimeError

• Exception Message: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):

  CUDA Setup failed despite GPU being available. Please run the following command to get more information:
  
  python -m bitsandbytes
  
  Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
  to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
  and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

  Stack Trace