-
Hello,
I am currently having big problems setting up an image under MAC. I have done the following steps:
1. git clone https://github.com/guysoft/CustomPiOS.git
Feedback:
Clone to 'CustomPiOS'…
-
我是阿里云服务器:
4核(vCPU)
30 GiB
GPU：NVIDIA P100
启动 python -u webgui.py --server_port=3000
torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 20.00 MiB. GPU 0 has a total capacity of 15.…
yeohx updated
2 months ago
-
I am trying to understand a performance degradation that has happened on upgrading from Trino 419 to Trino 463. Querying hive tables with zstd compressed data in s3 seem to run significantly slower in…
-
The function from the title is called .totalMemMb, which suggests a return value in _megabit_.
I found the actual return value to be in MiB, (mebibytes)
(Mb = megabit, MB = megabyte, MiB = mebibyte,…
-
### What is the issue?
It's again the https://github.com/ollama/ollama/issues/6011 issue.
**The issue is with embedding call with the model converted using convert_hf_to_gguf.py.**
litellm.ll…
-
I downloaded the binary on Mac M1 Max, even if says x86_64 seems to be able to be run. But I can't transcribe
```
whisper --model tiny.en sample.wav
Downloaded https://huggingface.co/ggerganov/wh…
tiero updated
2 weeks ago
-
I have a ~1.5TiB, ~1.7k files parquet dataset with an additional `_metadata.parquet` file containing metadata of all row groups. The `_metadata` file was written with the mechanism described in the [d…
-
```python benchmark.py --block-size 32 --size 128 --rdma```
when batch is big (> 4096), it takes around 1x ms. (gcc -O0)
this is too slow:
rdma_write:
mm->allocate add batch allocate, if it coul…
-
torch=2.4.1
cuda=cu124
xformers=0.0.28.post1
torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 2.25 GiB. GPU 0 has a total capacity of 11.00 GiB of which 0 bytes is free. Of the all…
-
Hi, when I try to run train.sh on two GPUs (TITAN RTX) with 24GB VRAM, I get the following errors:
> RuntimeError: CUDA out of memory. Tried to allocate 20.00 MiB (GPU 1; 23.65 GiB total capacity; 21…