-
Train with bf16 and zero stage 3 cause this error, the script:
```
######################################
ID=02
DS_CONFIG=${BASE_PATH}/ds_config_${ID}.json
ZERO_STAGE=3
cat number of…
-
### 🐛 Describe the bug
Hi,
I am using fsdp(integrated with hf accelerate) to extend support for the [transformer reinforcement learning library](https://github.com/lvwerra/trl) to multi-gpu. This …
-
![image](https://github.com/akshitagupta15june/Face-X/assets/57909583/cf6bd73c-5a7f-496e-90dd-b87ee955bb14)
-
http://www.impactaging.com/papers/v8/n5/full/100968.html
-
## Expected Behavior
The fine-tuning of the foundation model should complete without any issues.
## Actual Behavior
The fine-tuning step gets terminated. The details provided below:
T…
-
## Keyword: sgd
There is no result
## Keyword: optimization
### A Model-Constrained Tangent Manifold Learning Approach for Dynamical Systems
- **Authors:** Authors: Hai Van Nguyen, Tan Bui-Thanh
-…
-
Hello I haven't found a guide for Multiple gpu setup for Kohya has anyone got a step by step guide I keep getting errors trying to go by this on my own. There is no clear guide for this. be greatly ap…
-
### Description
Currently, if you want to filter a series based on its items, you have to re-reference the series:
```python
s = pl.Series([1, 2, 3])
s = s.filter(s < 3) # must use s in the fil…
-
Just to confirm the current best approach of multilabel classification with DALI.
I'm following the instruction from [#874](https://github.com/NVIDIA/DALI/issues/874) to create a multi-label loader…
-
I get this error when i press train model:
write filelist done
use gpus: 0
runtime\python.exe train_nsf_sim_cache_sid_load_pretrain.py -e twofer -sr 40k -f0 1 -bs 3 -g 0 -te 20 -se 5 -pg pretra…