Add checkpoint inspector

ReaLLMASIC / nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

MIT License

23 stars 17 forks source link

Closed gkielian closed 4 months ago

gkielian commented 4 months ago

This script allows quick inspection and report creation without needing to utilize tensorboard:

Can easily wrap the above into a hwatch or regular watch invocation for real-time updates:

watch --color 'python3 inspect_ckpts.py --directory ../mplp --sort loss'