add scaling laws notebook

[lvwerra]

Notebook to replicate Chinchilla scaling laws. Follows steps in D.2 (however for pass@k and its inverse rather than loss).

[Randl]

The csv file is missing?

[lvwerra]

Indeed, added it here: https://huggingface.co/datasets/bigcode/scaling-laws-exp/tree/main

[harm-devries]

Just pushed a fix for the optimization issues in the scaling laws. Fitted function now looks as follows:

[Randl]

Probably better make x-axis logscale