-
Hi, thank you for your effort and this is a real good tool!
I tried to use it for ddp, and the command cannot be identified.
I'm wondering if you could add support for it.
This is the command in th…
-
请问现在是不可以是用DDP进行训练吗,我自己也试了一下,在val阶段会有报错,是因为代码问题所导致的吗
-
## 🐛 Bug
Due to broadcasting of the buffers in DDP batchnorm will throw a "gradient computation has been modified by an inplace operation" which is not very intuitive. A simple repro is to use DDP …
-
Traceback (most recent call last):
File "/home/mvp/run/train_3d.py", line 473, in
main()
File "/home/mvp/run/train_3d.py", line 309, in main
train_3d(config, model, optimizer, train_l…
-
**Context**
In some use cases (e.g. DDSP audio synthesis) we want to perform F0 estimation on the GPU, so it's helpful to store PESTO as a submodule of our `pytorch_lightning.LightningModule`.
*…
-
Hi,
I was using `torch.func` in pytorch 2.0 to compute the Hessian-vector product of a neural network.
I first used `torch.func.functional_call` to define a functional version of the neural netw…
-
### 🐛 Describe the bug
Code:
------------------------------------------------------------
torchrun --standalone --nproc_per_node=1 train_reward_model.py --dataset Dahoas/rm-static …
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
脚本如下:
deepspeed --num_gpus 4 src/train_bash.py \
--deepspeed examples/deepspeed/ds_z3_config.json…
-
Major TODO items:
- [ ] convert `ddply` -> `lapply`
- [ ] better handling of leap-years
- [ ] add `hemisphere` argument for toggling N/S seasonal logic and defaults
- [ ] test for southern…
-
The current version of Hydronet works only on 1 GPU. The parallel version can be found here: https://github.com/jenna1701/hydronet/tree/schnet_ddp/challenge-1.5
I got the link yesterday, currently te…