search

delphi-suite / delphi

small language models training made easy
Apache License 2.0
9 stars 1 forks source link

simplify batching logic #85

Closed jaidhyani closed 6 months ago

jaidhyani commented 6 months ago

Rework training batches to just use a per-epoch-generated index instead of a generator, simplify related logic