Closed vchiley closed 1 year ago
using save_filename: ep{epoch}-ba{batch}/rank{rank}.pt puts sharded ckpts in folder structure.
save_filename: ep{epoch}-ba{batch}/rank{rank}.pt
using
save_filename: ep{epoch}-ba{batch}/rank{rank}.pt
puts sharded ckpts in folder structure.