-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I'm trying to load an embedding model from HuggingFace on multiple available GPUs using …
-
### Proposal
Change some code that could load model locally.
### Motivation
Today I want to load gpt2 model that download from huggingface website locally like Llama, but it keeps try to connc…
-
System Info
GPU: NVIDIA RTX 4090
TensorRT-LLM 0.13
quest 1: How can I use the OpenAPI to perform inference on a TensorRT engine model?
root@docker-desktop:/llm/tensorrt-llm-0.13.0/examples/apps# pyt…
-
### Describe the bug
```python
from typing import NamedTuple
from flytekit import task, workflow
class TaskOutputs(NamedTuple):
train_data: str
val_data: str
# namedtuple + str
…
-
**Describe the bug**
The bug involves inconsistent handling of the `_steps_attr` attribute in several classes inheriting from `_HeterogenousMetaEstimator`. Specifically, the `_steps_attr` attribu…
-
Hi
I ran into a problem while adjusting the code:
![image](https://github.com/user-attachments/assets/3f8b1d0d-33e5-4c1c-8d33-7762bff39261)
I wanted to use the glm4-9b-chat model to generate conve…
-
### Describe the issue
After I export the onnx model with [huggingface optimum](https://github.com/huggingface/optimum), I run the following script to check my model which has no issue.
```python
i…
-
I see some of my runs missing tensors compared to the ones that when I load to work on my evals e.g., see wrong
```bash
(AI4Lean) root@miranebr-math-p4de-math-aif-sft:~/data/runs/10092024_03h17m15s_…
-
I have fine-tune Table Structure Recognition model for with 20 epoch, inference result are also getting but to get evaluation metrics script not giving any result and freeze for forever
**Command u…
-
### System Info
- `transformers` version: 4.44.0
- Platform: Linux-6.9.3-76060903-generic-x86_64-with-glibc2.35
- Python version: 3.10.12
- Huggingface_hub version: 0.23.3
- Safetensors version: …