search

SakanaAI / AI-Scientist

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬
Apache License 2.0
7.91k stars 1.09k forks source link

Nano gpt training results #119

Closed deepak-lenka closed 1 week ago

deepak-lenka commented 1 month ago

Description:

This pull request adds the results and analysis of a nanoGPT training experiment on the Shakespeare dataset. The main contributions include:

  1. Training log: A detailed log of the training process, including loss values and iteration times.
  2. Summary report: An overview of the experiment, including key metrics, observations, and insights gained from the training.
  3. Experiment notes: A detailed account of the experimental setup, challenges faced, lessons learned.
conglu1997 commented 1 week ago

We don't want to add this since training speeds are hardware dependent.