-
Sample for Finetuning SD models will be supported in 2.16. Corresponding samples need to be supported in optimum-neuron
-
Neuron SDK 2.15 releases beta support for` torch.compile() `for inference. This needs to be supported as an option for models
-
# URL
- https://arxiv.org/abs/2104.08696
# Affiliations
- Damai Dai, N/A
- Li Dong, N/A
- Yaru Hao, N/A
- Zhifang Sui, N/A
- Baobao Chang, N/A
- Furu Wei, N/A
# Abstract
- Large-scale pr…
-
I am trying to retrieve the logits from the model, to use https://github.com/EleutherAI/lm-evaluation-harness/blob/692e0f83b5341b543fa288f84289617f793e4e93/lm_eval/models/huggingface.py#L972
#### …
-
## Context
The call ```myspecies.nodes``` to get all compartments that have ```myspecies``` is very slow.
The call ```h.finitialize()``` is also very slow.
### Overview of the issue
In our…
-
There are no attributions or information on where these algorithms were originally developed.
-
I am attempting to download model checkpoints from the Azure Blob Model Registry associated with this repository. However, access denial errors appear to suggest that there's no public access to that …
-
### Deep Learning Simplified Repository (Proposing new issue)
:red_circle: **Credit Risk Prediction using Neural Networks** :
:red_circle: **To be able to correctly predict the credit risk of an in…
-
### Your current environment
```text
See below for detailed setup and run script that I use.
```
### 🐛 Describe the bug
Hi I'm trying to deploy llama-8b using vllm on aws inferentia (inf…
-
Error when running sample **python3 examples/offline_inference_neuron.py**, after installing v0.3.3 (from cloned source or from pip install git+...).
### Cause:
directory **vllm/model_executor/m…