-
Hi there, you made fantastic framework for llms. But what I find very confusing is how to run this on cuda and direct ml. I simply don't know how to do it in C#..
I there any example? Second questio…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussion…
-
Hi,
Is there a way to specify which GPU to use for inference, such as restricting it to only `cuda:0` or `cuda:1` in the code? Or are there any workarounds for achieving this?
Thanks in advance…
-
# This is my terminal output:
(llavatest) nvidia@nvidia-desktop:/home/Storage/workplace$ python -m bitsandbytes
Could not find the bitsandbytes CUDA binary at PosixPath('/home/Storage/anaconda3/envs…
-
CMake starts by warning `No CUDA support found` but then goes on to find CUDA and compile. I haven't had a chance to investigate. looks harmless.
```
[jrmales@exao3 _build]$ make
CMake Warning …
-
Hello,
I've been trying to qwen2 0.5B and tinyclip using the repository, but I'm running into CUDA OOM issues on the dense2dense distillation step. Im running on 4 80GB A100s, I was wondering if I …
-
What is the right version of pytorch and cuda for this project? Because I have tried several versions of cuda always error
-
Anybody facing this error ?
nitFluxLoRATraining
'C:\Users\User\Desktop\Train\New folder' is not a dire…
-
On systems where the CUDA SDK does not already exist, distributed .exe versions of WebCT crash on startup with a `KeyError: 'CUDA_PATH'`
This is due to TIGRE not using the bundled cuda sdk, but ins…
-
- Thanks for sharing a great project. I tested offline and had a problem with Cuda out of memory.
- When I looked at the demo.ipynb notebooks tutorial, I saw that you put the whole video on GPU: vide…