ReaLLMASIC / nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.
MIT License
23 stars 17 forks source link

Added boxplots #174

Closed mmoffatt2 closed 3 months ago

mmoffatt2 commented 3 months ago

For statistics, added a boxplot graph option.

Also, added the argument box_plot_interval which allows for the creation of box plots of all input/output values at certain specified intervals of iteration. For example, with box_plot_interval=1000, a box plot will be created using the input/output values of one iteration every 1000 iterations. This will allow us to compare the input/output statistics throughout training.

Also, made some fixes to the other plots so that legends and text aren't cut off.

Some example box plots: image image

gkielian commented 3 months ago

Looks great! : D

Merging.