-
### 🐛 Describe the bug
Calling full_tensor() is giving incorrect tensors here.
I have created a minimal model to test checkpoint saving. I tried using DCP as well but that also gives incorrect ten…
-
When i run this
//set device
device = 'cuda' # or cpu
torch.set_default_device(device)
all other code (https://huggingface.co/BAAI/Bunny-v1_1-Llama-3-8B-V)
//generate
output_ids = model.…
-
## 🐞Describing the bug
This is a follow up on https://github.com/apple/coremltools/issues/2275. Sorry I couldn't find the reopen option in the original issue.
To clarify, the issue didn't happen wit…
-
### Describe the issue:
Hello, guys.
I am using spikeinterface to run Kilosort and I am encountering this error. I tried using kilosort 4.0.13 as well and found the same results. I opened an issu…
-
I am trying to run text classification notebook given in Inference docs, The notebook worked fine or the models LLama3 to tiny llama till morning IST. But, now these are giving strange size mismatch i…
-
I implemented a backpropagation op.
```python
@triton.jit
def silu_grad(dy, x):
dtype = x.dtype
dy = dy.to(tl.float32)
x = x.to(tl.float32)
s_acc = fast_dividef(1.0, 1.0 + fas…
-
## ❓ Questions and Help
I use this code
```
import unittest
import torch
import torch.nn.functional as F
import torch_xla
import torch_xla.core.xla_model as xm
class TestInterpolate(unittest.…
-
Hello everyone, i have 4 gpus RTX 3080 with 10 GiB each and im trying to fine tune mistral 7B v2.0 localy, i tried to optimize as much as i can...(Accelerate with DeepSpeed, 4bit quantization, LoRa an…
-
### Describe the issue as clearly as possible:
Encountered while working on PR [531](https://github.com/outlines-dev/outlines/pull/531)
When generating several samples for a prompt with the tran…
-
# Bug Report
### Is the issue related to model conversion?
No
### Describe the bug
Running the test suite on s390x produces failures involving `test_make_tensor_raw` as well as `test_make_xxx_…