-
Hi Phil, thanks for the great repo and examples!
Everything worked well when I played with llama3-70b using your guide, but now I'm stuck when fine-tuning llama3.1-70b.
I've done all the steps …
-
### System Info
transformers version: 4.41
Platform: Red Hat Enterprise Linux 8.4 (Ootpa)
Python version: 3.10.14
PyTorch version 2.3+cu118
### Who can help?
@sanchit-gandhi @SunMarc
### Inf…
-
## 🔨Work Item
- [x] Refactor `examples/pytorch/graphsage/advanced/train_sampling_unsupervised.py` to follow the latest dataloader interface and move it to `examples/pytorch/multigpu/multi_gpu_link_…
-
command:
```
cm run script --tags=run-mlperf,inference,_find-performance,_full,_r4.1 \
--model=gptj-99 \
--implementation=reference \
--framework=pytorch \
--category=edge \
--sc…
-
### System Info
```Shell
- `Accelerate` version: 0.34.2
- Platform: Linux-5.15.0-92-generic-x86_64-with-glibc2.35
- `accelerate` bash location: /mnt/ttsnas/tshmak/WORK/Projects/TTS/FanoOpenVoice…
-
## ❓ Questions and Help
Hi!
We are trying to train Gemma-2-9B on v4-64 and v5-128 Pod as mentioned in [this comment](https://github.com/pytorch/xla/issues/7987#issuecomment-2352326629). We use FS…
ayukh updated
8 hours ago
-
hi, I tried to compile openfst and pynini on a aarch64 machine. Although the version of openfst and pynini match, I still met with some troubles after a successful installation of openfst. BTW, I want…
-
(TE) root@bjdb-h20-node-118:/aml/TransformerEngine/examples/pytorch/fsdp# torchrun --standalone --nnodes=1 --nproc-per-node=$(nvidia-smi -L | wc -l) fsdp.py
W0712 09:57:45.035000 139805827512128 torc…
-
### Description
With version>2.0, the import path of PyTorch Lightning has been updated from `import pytorch_lightning` to `import lightning.pytorch`.
Although `import pytorch_lightning` still …
-
I encounter such erros during my training script, when using flash ckpt and installed dependencies by 'pip install dlrover[torch] -U'