-
### Your current environment
```text
The output of `python collect_env.py`
```
```
Collecting environment information...
/scratch/gpfs/hyen/p-long-instruct/vllm_env/lib/python3.11/site-package…
-
Jan,
I work on an open source project for seismic imaging and signal processing in the oil exploration industry, JavaSeis.org. The JCOOL package looks like a great Java based platform for optimizatio…
-
Hi Team,
I am getting following error while moving data from xla to cpu device. I am using Neuron 2.13.0 this version.
low_res_pred1 = low_res_pred.to('cpu')
low_res_pred is the model output of…
-
### Feature request
I've a conceptual question
BERT-base has a dimension of 768 for query, key and value and 12 heads (Hidden dimension=768, number of heads=12). The same is conveyed if we see the…
-
Thank you, this is a great addition for the merger space, but just wanted to ask if you thought about adding various merge_methods?
https://github.com/s1dlx/meh/blob/81515bda3cba52edd263964c5517f47…
-
### Your current environment
The output of `python collect_env.py`
```text
PyTorch version: 2.3.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N…
-
I'm getting this error when calling:
```
from bertviz.transformers_neuron_view import BertModel, BertTokenizer
```
With Python 3.11. The `Mapping` location has been updated but this is not ref…
-
Translation of mod files with `VERBATIM` blocks defined after a `NEURON` block with `THREADSAFE` keyword fail with the same error as without having the `THREADSAFE` keyword, complaining about thread s…
-
### Your current environment
Hello,
I'm trying to download llama3.1-8B-Instruct to my PC and each time i try, i get the following error:
```bash
[rank0]: torch.OutOfMemoryError: CUDA out of memo…
-
**Describe the bug**
SageMaker adds wrongly `/` when using `S3DataSource` where files are stored in an nested order, see screenshot of how my s3 directory looks.
![image](https://github.com/aws/sag…