-
Thank you guys for your work!
i was using fsdp + qlora fine tuning llama3 70B on 8* A100 80G, and i encountered this error:
```shell
Traceback (most recent call last):
File "/mnt/209180/qis…
-
### System Info
peft = 0.13.2
python = 3.12.7
transformers = 4.45.2
### Who can help?
@sayakpaul
I am using ```inject_adapter_model(...)``` to finetune a model from OpenCLIP using LoRA layers…
-
This package currently supports vectors and matrices like this:
```julia
@satvariable(z[1:5,1:5], Bool)
```
But, it doesn't currently support higher dimensional tensors. For example, this fails:
…
-
## 🐛 Bug
### To Reproduce
Here's a problematic pattern where Thunder's rematerialization algorithm is not effective:
```py
from torch.nn import Linear
import torch
import thunder
bl…
-
Currently there are quite some logics to decide how a weight tensor should be put on device: [prepare_conv_weights_biases_and_move_to_device](https://github.com/tenstorrent/tt-metal/blob/14a6f6f086e88…
-
d_collated = self.tokenizer.pad(
passages_inputs,
padding=self.padding,
max_length=self.query_max_len,
pad_to_multiple_of=self.pad_t…
-
### Run Information
Name | Value
-- | --
Architecture | x64
OS | Windows 10.0.22621
Queue | TigerWindows
Baseline | [5db0ce0fa2e206da664498044af233a044f9aeb7](https://github.com/dotnet/runtime/com…
-
### 1. System information
- OS Platform and Distribution: Pop!_OS 22.04 LTS
- TensorFlow installation: pip package
- TensorFlow library: 2.17.0
### 2. Code
```
import tensorflow as tf
…
-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/axolotl-ai-cloud/axolotl/labels/bug) didn't find any similar reports.
### Exp…
-
Click to expand!
### Issue Type
Feature Request
### Source
binary
### Tensorflow Version
2.10
### Custom Code
No
### OS Platform and Distribution
_No response_
### Mobile device
_No res…