-
Running the Tutorial to fine-tune bert with optimum-neuron hits an error "Found no NVIDIA driver on your system." when using transformers=4.30.0
Tutorial
https://www.philschmid.de/getting-started…
-
Hi,
when can we expect the support for Mixtral 8x7B ?
I can see Mistral 7B is not supported yet.
Thanks
-
# ❓ Questions and Help
The titles sums it all, do I need a CUDA device or is Xformers compatible with other devices?
-
# Issue Metrics
| Metric | Average | Median | 90th percentile |
| --- | --- | --- | ---: |
| Time to first response | 2:49:00 | 0:01:51 | 3:39:45 |
| Time to close | 15:31:49 | 0:51:06 | 2 days, 8:15…
-
### System Info
```shell
optimum-neuron 0.0.18
optimum 1.16.2
platform: amazon linux 2
Python 3.8.16
Traceback (most recent call last):
File "[venv path]/opti…
-
I have some scripts to train a BERT model on WikiText2. When testing it on both torch `2.1.2` and `1.13.1`, the scripts get compiled and executed successfully. The issue is that when running `bert_van…
-
Kubernetes 1.19For more information about Kubernetes 1.19, see the official release announcement.Starting with 1.19, Amazon EKS no longer adds the kubernetes.io/cluster/my-cluster tag to subnets p…
-
**Environment**
Python: 3.10.12
device : trn1.2xlarge
neuronx-cc: 2.14.227.0+2d4f85be
torch-neuronx: 2.1.2.2.2.0
neuronx-distributed: 0.8.0
```bash
$ dpkg-query -W -f='${binary:Package} ${Ver…
-
The Neuron SDK compiles models for the Trainium accelerator. The compiled model is then stored in a disk cache, which saves time for further training jobs.
With SageMaker, the model is recompiled e…
-
AWS has their own purpose built silicon offerings AWS Trainium and Inferentia. They both are supported on Ray too. Can we please have them added to Skypilot ?