isolate and test actual training parts of train_step in their own function

delphi-suite / delphi

small language models training made easy

Apache License 2.0

9 stars 1 forks source link

isolate and test actual training parts of train_step in their own function #78

Closed jaidhyani closed 6 months ago

jaidhyani commented 6 months ago

train_step should be a function that just performs the actual training step - other logic should be moved elsewhere/renamed. This function should be aggressively tested for correctness.