search

SakanaAI / AI-Scientist

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬
Apache License 2.0
7.53k stars 1.01k forks source link

why model compiling? #91

Open xprabhudayal opened 2 weeks ago

xprabhudayal commented 2 weeks ago

image does there any usage of the models (nanogpt, nanogpt_lite ...) in later time in launch_scientist.py or is it just for comparing with the baseline results?

in this image we are compiling the model, & upon later analysis or the code in launch_scientist.py we are just comparing with the baseline results

conglu1997 commented 2 weeks ago

Yes these are the baseline runs to compare any future ideas or proposals against.

xprabhudayal commented 2 weeks ago

Can't we just distribute the cached baseline results, to avoid the heavy task of compiling 🤔

On Sun, Sep 1, 2024, 11:16 PM Cong Lu @.***> wrote:

Yes these are the baseline runs to compare any future ideas or proposals against.

— Reply to this email directly, view it on GitHub https://github.com/SakanaAI/AI-Scientist/issues/91#issuecomment-2323439366, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6UFP3B4NHDAWLPYW5WDHJTZUNHI5AVCNFSM6AAAAABNOUCO46VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMRTGQZTSMZWGY . You are receiving this because you authored the thread.Message ID: @.***>

conglu1997 commented 2 weeks ago

See the FAQ, no because things like runtime comparisons are machine dependent :)