-
### System Info
Hello I am trying to load Mistral-Nemo Instruct-2407 in bnb 4bit on 4 A10 gpus on ec2 instance.
I upgraded all the packages.
Still I face cuda memory out of error when train batc…
-
### Your current environment
conda create -n Fp_8 python=3.10 -y
conda env list
conda activate Fp_8
pip install vllm
pip install nvidia-cublas-cu12==12.3.4.1(H20)
pip install llmcompressor==0.1…
-
Hi,
With the maturity of Panama [Foreign-Function and Memory API](https://openjdk.org/jeps/454) now official in java 22, are there future plans JOCL and of course JCUDA to utilise it? I've seen it…
-
Hello, very nice video, and very nice tutorial on alternatives to langchain.
I am having troubles with haystack however, I tried to overcome dependency issues but couldn't get ingest.py to work pr…
-
Hi,
we met the problem when we ran code with our own adata:
AnnData object with n_obs × n_vars = 28374 × 25086
obs: 'cell_subtype', 'batch', 'n_genes_by_counts', 'total_counts', 'total_counts…
-
### Your current environment
```text
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 20.04.6 LTS (x86_64)
GCC ve…
-
Requirement already satisfied: packaging in ./venv/lib/python3.11/site-packages (from -r requirements.txt (line 1)) (21.3)
Collecting torch==2.1.0 (from -r requirements.txt (line 2))
Using cached …
-
-
I've just finished the HU NL Holdem game that runs on the GPU as a part of the [Spiral playlist](https://www.youtube.com/playlist?list=PL04PGV4cTuIVP50-B_1scXUUMn8qEBbSs). The screencast showing the i…
-
### RuntimeError: The expanded size of the tensor (628) must match the existing size (129) at non-singleton dimension 3. Target sizes: [1, 32, 1, 628]. Tensor sizes: [1, 1, 1, 129]
Issue: Upon ru…