-
# ❓ Questions and Help
The titles sums it all, do I need a CUDA device or is Xformers compatible with other devices?
-
**Tell us about your request**
What do you want us to build?
**Which service(s) is this request for?**
This could be Fargate, ECS, EKS, ECR
**Tell us about the problem you're trying to solve. …
-
Running the Tutorial to fine-tune bert with optimum-neuron hits an error "Found no NVIDIA driver on your system." when using transformers=4.30.0
Tutorial
https://www.philschmid.de/getting-started…
-
Hi,
when can we expect the support for Mixtral 8x7B ?
I can see Mistral 7B is not supported yet.
Thanks
-
I am following this [tutorial ](https://www.philschmid.de/optimize-deploy-bert-inf2) on how to deploy LLM to AWS inferentia2.
When I try to convert the model to AWS neuron using the optimum-cli
…
-
I have some scripts to train a BERT model on WikiText2. When testing it on both torch `2.1.2` and `1.13.1`, the scripts get compiled and executed successfully. The issue is that when running `bert_van…
-
This document includes the features in vLLM's roadmap for Q2 2024. Please feel free to discuss and contribute to the specific features at related RFC/Issues/PRs and add anything else you'd like to tal…
-
### System Info
```shell
optimum-neuron 0.0.18
optimum 1.16.2
platform: amazon linux 2
Python 3.8.16
Traceback (most recent call last):
File "[venv path]/opti…
-
### System Info
```shell
I used the official optimum neuron AMI for Trainum.
https://aws.amazon.com/marketplace/pp/prodview-gr3e6yiscria2
```
### Who can help?
_No response_
### Information
…
-
The Neuron SDK compiles models for the Trainium accelerator. The compiled model is then stored in a disk cache, which saves time for further training jobs.
With SageMaker, the model is recompiled e…