-
Latest `transformers=4.44.2` packages from HuggingFace uses `torch.isin()` which prevents graph break in certain control flows. It also adds the condition branch to avoid `copy.deepcopy` which is not …
-
### 🚀 The feature, motivation and pitch
When creating a heterogeneous model by using `torch_geometric.nn.to_hetero_with_bases()`, using `torch.nn.parameter.Parameter` directly as a layer is unsupport…
-
```python
from thunder.benchmarks.targets import LitGPTConfig, LitGPTBenchmark, backward_only
import torch
import thunder
from thunder.executors.transformer_engineex import transformer_engine_ex
…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a…
-
```python
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
@torch.compile(backend="turbine_cpu")
def test_gpt2_demo():
tokenizer = AutoTokenizer.from_pretrained("gp…
-
(chatglm) n:\github\GLM-4>python openai_api_lby.py
2024-06-12 15:24:16,061 - Start initialize model...
Special tokens have been added in the vocabulary, make sure the associated word embeddings are …
-
# Description:
When running a batch of 32 graphs using the GraphTransformer object, there is a notable increase in GPU memory usage during the operation on the edges. The memory spikes from approxima…
-
### System Info
```shell
python 3.10.14
torch 2.4.0+cu121
optimum 1.21.4
onnx 1.16.2
onnxruntime 1.19.0
transformers 4.43.4
optim…
-
### OpenVINO Version
2023.3
### Operating System
Fedora Silverblue 39
### Device used for inference
GPU
### Framework
PyTorch
### Model used
llava-hf/llava-1.5-7b-hf
### …