-
Hi,
I use layernorm and rmsnorm in my training pipeline on an A100 and observed via the pytorch profiler that these functions were quite slow.
E.g. I measured via time.time() just for the rmsnorm:
…
-
[PyTorch v2.3.1 릴리즈](https://github.com/pytorch/pytorch/releases/tag/v2.3.1)를 반영합니다.
---
## 신규 버전 반영을 위해 할 일 목록
### 홈페이지 반영
- [x] [공식 홈페이지 저장소](https://github.com/pytorch/pytorch.github.io/commits/s…
9bow updated
2 months ago
-
Hi,
Does Determined support the PyTorch FSDP way of distributed training? I can see examples for DeepSpeed, but I have a requirement to specifically use native FSDP feature of PyTorch 2.2 (something…
-
## 🐛 Bug
Some tutorials still return non-detached tensors in `training_step` - this is deprecated in 1.6 and may cause memory leaks if people follow those patterns.
e.g.
[ output = …
-
**Describe the bug**
When attempting to run fuzzy deduplication on a dataset that has no duplicates, the code errors out.
**Steps/Code to reproduce bug**
1) Clone the repo
2) Run the TinySto…
-
Is there a plan to add a classify task, just like original YOLO?
I use both classify and detect task from the original yolov8 and would like to replace both with your repo.
-
it seems that this function is not explicitly implemented in the script?
-
# Documentation Problem/Question/Comment
ray Trial runs this line here: https://github.com/ray-project/ray/blob/6b53df95990bfac235313f24f80176948339b606/python/ray/tune/trial.py#L438
Passing a fun…
-
### Issue Type
Bug
### Source
pip (mct-nightly)
### MCT Version
PR #1186
### OS Platform and Distribution
Linux Ubuntu 22.04
### Python version
3.10
### Describe the issu…
-
Running batch trials is currently disabled in favor of early stopping, as both strategies were conflicting on Ax' side. Manually performing early stopping once the best-point/best-pareto can be return…