-
from trl import SFTTrainer
from transformers import TrainingArguments
from unsloth import is_bfloat16_supported
trainer = SFTTrainer(
model = model,
tokenizer = tokenizer,
train_da…
-
Hi, for the following formula,
~~~~
(set-logic BV)
(declare-const v0 Bool)
(declare-const v1 Bool)
(declare-const v4 Bool)
(declare-const v5 Bool)
(assert (forall ((q0 Bool) (q1 Bool) (q2 Bool)…
-
Hello,
we have noticed some unexpected behaviors when fine-tuning a llama 3 model on 1 gpu and when fine-tuning the same model on the same data set with 2 gpus in parallel mode. See the attached te…
-
Greetings,
I'm currently trying to compile the following model:
```python
import brevitas.nn as qnn
import torch.nn as nn
from brevitas.quant import (
Int8ActPerTensorFixedPoint as ActQu…
-
After processing some PDB files from [PINDER](https://github.com/pinder-org/pinder) with `process_pdb_files.py` when running the training I get
```
python -W ignore experiments/train_se3_flows.py da…
-
Affected versions: 78f5c2936b7bdaa56859075a3f2fcc5a63952134, 5fa9436e17c2f9aeace070f49aa645d2577f676b
Affected APIs: GptManager, Executor
Hardware: H100
```
python examples/llama/convert_checkpoint.p…
-
### Search before asking
- [X] I searched the [issues](https://github.com/ray-project/kuberay/issues) and found no similar issues.
### KubeRay Component
ray-operator, apiserver
### What happened …
-
new version of transfomer, no need to use BetterTransformer, try setting attn impl to sdpa...
attn imp:
Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used …
-
### System Info
### System Info
GPU: NVIDIA A100
Driver Version: 545.23.08
CUDA: 12.3
versions:
https://github.com/NVIDIA/TensorRT-LLM.git (5fa9436) (latest version)
https://github.com/trit…
-
### 🐛 Describe the bug
import numpy as np
import torch
import os
import torch
# Might not be necessary
os.environ.setdefault("KMP_DUPLICATE_LIB_OK", "True")
#import pytorch_GRU
#import qua…