-
### System Info
```
accelerate 0.33.0
peft 0.12.0
Python 3.12.5
macOS: 15.0
MacBook pro M1 Pro 16 gb
```
### Who can help?
### Information
- [ ] The officia…
-
_Downstream PyTorch issue:_
https://github.com/pytorch/pytorch/issues/133780
I'm trying to do attention on a batch-of-zero, because my program uses a static graph and I rely on zero-batching (in…
-
In order to save memory space while batch processing, our workflows usually had a "clearing memory" step that uses the "remove objects" module. However, I just ran into the issue that objects cannot b…
-
**System information**
- Have I written custom code (as opposed to using a stock example script provided in TensorFlow): Both
- OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows + Lin…
talmo updated
1 month ago
-
Promethues metric locust_running is always zero during distributed load tests, any clues?
-
### System Info
L4 GPU (AWS G6.12xl) with TensorRTLLM 0.11.0, running with Tritonbackends
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [ ] My own modified …
-
### Discussed in https://github.com/Krukov/cashews/discussions/264
Originally posted by **sohang123** August 20, 2024
We were originally using simple caching with both a redis and memory (pref…
-
Today `job_create` and `batch_create` take `client_id` and `client_version` parameters. We make the effort to document and validate them but then we just throw their values away. We should remove thes…
-
[DAP-04](https://www.ietf.org/archive/id/draft-ietf-ppm-dap-04.html#name-batch-validation) says:
> Next, the Aggregator checks that batch contains a valid number of reports, as determined by the qu…
-
Hi, I'm processing the huge bread-midi-dataset.
Training the tokenizer throws a KeyError in midi_tokenizer.py
line 1712: ids = [self.vocab[token] for token in tokens]
maybe line 1709 needs a f…