-
**Description**
If I loaded 2 model transformer and inference model, memory GPU used about 3Gi.
```
PID USER DEV TYPE GPU GPU MEM CPU HOST MEM Command
2207044 coreai 0 C…
-
Hello,
I am not able to load `sentence-transformers/distiluse-base-multilingual-cased-v2` model. Script example:
```python
from sentence_transformers import SentenceTransformer
model_name = …
-
I just follw the step, but when I run the following code :
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Efficient-Large-Model/Llama-3-VILA1.5-8B")
…
-
### Describe the bug
Hello,
I was trying to fine tune a mT5 model (google/mT5 series models) on a custom dataset that follows the text format given in your documentation for the column data load…
-
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
** Facing error with using Langchain wrapped hugging face models**
I am …
-
Hello,
I want to run:
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("NVEagle/Eagle-X5-13B-Chat")
But I get:
ValueError: The checkpoint you are tr…
-
https://outlines-dev.github.io/outlines/reference/models/transformers/
```python
outlines_tokenizer = outlines.models.TransformerTokenizer(
transformers.AutoTokenizer.from_pretrained(model_…
-
We are trying to perform fine tuning with the Gliner model. However, we get an error when loading the model because the model cannot see the config.json file. When we load the config.json file manuall…
-
Hi TensorRT-LLM team, Your work is incredible.
By following the READme file for [multi-modeling](https://github.com/NVIDIA/TensorRT-LLM/blob/main/examples/multimodal/README.md), we were sucess to run…
-
## 🐛 Bug
The issue looks related to **lifted constants** during `torch.export`, I found a commit https://github.com/pytorch/xla/commit/d8d7e58b78664aff2713e5f25adb3d61c42d44e7 might be related, but…