-
`sky launch` is failing with an error from Cudo API. Also reported by users on slack.
```
(base) ➜ ~ sky launch -c vm --cloud cudo --gpus A6000
I 08-13 07:49:33 optimizer.py:691] == Optimizer ==…
-
## Issue
Encountered a deadlock while running a JAX-based LLM training script on a TPU-v4-32 pod. SSH'd into worker 0 and ran the script there directly, instead of using `--worker all --command "..."…
-
## Version of the custom_component
1.7 la
## Configuration
```yaml
algorithm:
initial_temp: 1000
min_temp: 0.1
cooling_factor: 0.95
max_iteration_number: 100
devices:
- nam…
-
Hi,thanks for your good work!
But I have some problem about SemanticSegmentation/config/ViT-B-RVSA_config.py.
![image](https://github.com/NJU-LHRS/official-CMID/assets/73222755/d97d8da5-4fc8-414d-b1…
-
Problem demo: https://godbolt.org/z/zfMohEMj7
The "good" variant produces perfectly optimized code, while the nearly-identical "bad" variant produces a giant explosion of seemingly unoptimized code…
-
### Describe the issue
Hi,
I'm wondering how to use ````ipex.optimize(...)```` when I have two models, for example, teacher and student in model distillation but only one optimizer. Would calls like…
-
**Describe the bug**
I use llama-2 7b, and when I start stage 2 in EE-Tuning, the bug occurs.
**To Reproduce**
here is `llama2_7B_1_exit_mlp_pt.sh` I modified:
``` bash
#!/bin/bash
PROJECT…
-
**What**
Provide a TTNN API to return Op perf estimate to the TT-MLIR optimizer. The goal of this issue is to do an end-to-end PoC and conclude what would be the proper solution. Based on the conclus…
-
The recent addition of optimizer CPU offload in torchao can be useful for single GPU low memory config.
https://github.com/pytorch/ao/tree/main/torchao/prototype/low_bit_optim#optimizer-cpu-offload…
-
**Your question**
Is it possible to load an optimizer that was previously saved using a distributed optimizer configuration, and then continue the training without employing a distributed optimizer?