search

dingo-actual / om

An LLM architecture utilizing a recurrent structure and multi-layer memory
https://github.com/dingo-actual/om
Apache License 2.0
11 stars 0 forks source link

Add Accelerate DDP to training script #13

Closed rtaylor-rx-m closed 1 week ago

rtaylor-rx-m commented 1 week ago

Currently not utilizing DDP

dingo-actual commented 1 week ago

Implemented