-
I've got a brand new Orin AGX developer kit (64GB) and used the SDK Manager to download and flash the latest Ubuntu (22.04) and JetPack SDK (6.1).
I'm trying to build a container (I need diffusers …
-
I wanted to test WhisperFusions on rtx3090.
Went throught build.sh and then:
`docker run --gpus all --shm-size 64G -p 6006:6006 -p 8888:8888 -it ghcr.io/collabora/whisperfusion:latest
`
and I ru…
rvsh2 updated
4 months ago
-
@ggerganov do you have any interest in producing more models in GGML format?
I'm now convinced your approach of zero dependency, no memory allocation cpu-first ideaology will make it accessible to…
-
### Your current environment
```text
PyTorch version: 2.1.2+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 20.04.6 LTS (x86_64)
GCC …
-
### Your current environment
```text
The output of `python collect_env.py`
Collecting environment information...
PyTorch version: 2.3.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12…
-
### Your current environment
```text
vllm v0.4.0.post1 CUDA 12.2
```
### 🐛 Describe the bug
```text
[2024-04-17 20:07:13,727] [ERROR] [MainThread] [asyncio] >>> File "/usr/local/lib/python3.…
-
### Your current environment
```test
python collect_env.py
Collecting environment information...
WARNING 07-22 17:54:45 _custom_ops.py:14] Failed to import from vllm._C with ModuleNotFoundError("N…
-
Env:
- torchao==0.1 (tried 0.3.1 and ends up with same error)
- torch==2.5.0.dev20240716+cpu
In ExecuTorch https://github.com/pytorch/executorch/pull/4320, I ran into this error when tryin…
-
### Current Behavior:
- Built llama.cpp with sycl backend for Windows by following instructions in README-sycl.md.
- The build completes successfully, the conversion and everything works fine.
- …
-
**System information**
- OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
- Macbook M1 Pro
- XCode version 15.0.1
- TensorFlow installed from (source or binary):
```
pod 'Ten…