Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback): CUDA Setup failed despite GPU being available. Please run the following command to get more information: python -m bitsandbytes Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues #1387

Open
smillpine opened this issue Oct 11, 2024 · 0 comments

Comments

@smillpine
Copy link

smillpine commented Oct 11, 2024

System Info

System Information

  • ComfyUI Version: v0.2.2
  • Arguments: E:\ComfyUI\ComfyUI-aki\ComfyUI-aki-v1.3\main.py --auto-launch --preview-method auto --disable-cuda-malloc
  • OS: nt
  • Python Version: 3.11.6 | packaged by conda-forge | (main, Oct 3 2023, 10:29:11) [MSC v.1935 64 bit (AMD64)]
  • Embedded Python: false
  • PyTorch Version: 2.3.1+cu118

Devices

  • Name: cuda:0 NVIDIA GeForce RTX 3080 Ti : cudaMallocAsync
    • Type: cuda
    • VRAM Total: 12884246528
    • VRAM Free: 11597250560
    • Torch VRAM Total: 0
    • Torch VRAM Free: 0

Reproduction

ComfyUI Error Report

Error Details

  • Node Type: Joy_caption

  • Exception Type: RuntimeError

  • Exception Message: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):

      CUDA Setup failed despite GPU being available. Please run the following command to get more information:
    
      python -m bitsandbytes
    
      Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
      to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
      and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
    

Stack Trace


### Expected behavior

# ComfyUI Error Report
## Error Details
- **Node Type:** Joy_caption
- **Exception Type:** RuntimeError
- **Exception Message:** Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):

        CUDA Setup failed despite GPU being available. Please run the following command to get more information:

        python -m bitsandbytes

        Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
        to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
        and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
## Stack Trace
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant