ReaLLMASIC / nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.
MIT License
23 stars 17 forks source link

Add vizier optimization #186

Closed klei22 closed 2 months ago

klei22 commented 2 months ago

This creates a new script run_vizier.py, which utilizes a config.json file in the same format as the run_experiments.py config.json file, and has a choice of different optimization algorithms for searching the space.

Adding as draft for now, will clean up and test further then post for review.