SakanaAI / AI-Scientist

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬
Apache License 2.0
7.43k stars 989 forks source link

nanoGPT_lite sanity check...RuntimeWarning: Mean of empty slice. #89

Open MrEdwards007 opened 2 weeks ago

MrEdwards007 commented 2 weeks ago

Good day, I ran the following code as part of the instructions for the sanity check but receive the error "Mean of empty slice" along with a follow-on error of "RuntimeWarning: invalid value encountered in scalar divide"

OS : Ubuntu 22.04.4 LTS Driver Version : 535.183.01 CUDA Version : 12.2 Attached GPUs : 1 Product Name : NVIDIA RTX A4500 Laptop GPU Product Brand : NVIDIA RTX

cd templates/nanoGPT_lite && python experiment.py --out_dir run_0 && python plot.py

I would like to know how to address this. I havent seen anyone else encounter this error. This comes directly after performing the installation and following the instructions on https://github.com/SakanaAI/AI-Scientist

image

luchris429 commented 2 weeks ago

That's our bad! Can't calculate the std when there's just one seed.

https://github.com/SakanaAI/AI-Scientist/blob/b30cf8aedd0834d97b581f8c6ec8bb9cb8ccd380/templates/nanoGPT_lite/experiment.py#L703

Hanochhu commented 2 weeks ago

That's our bad! Can't calculate the std when there's just one seed.

https://github.com/SakanaAI/AI-Scientist/blob/b30cf8aedd0834d97b581f8c6ec8bb9cb8ccd380/templates/nanoGPT_lite/experiment.py#L703

Update templates folder is only thing to do ? I did that but issue still when I run nanoGTP_lite baseline

conglu1997 commented 2 weeks ago

Can you check if the .json and .npy files are still valid and contain results? This error is a bit hard to reproduce (only happens a small amount of the time) and when it occurs for me, the files are still fine.

LMJOK commented 1 week ago

I have the same problem, how can I solve it? 1725242584994

conglu1997 commented 1 week ago

I think this is just a warning, you can check all your .json and .npy, and verify there is no problem.

gaoshaojie0708 commented 1 week ago

Is this problem solved? I also encountered the same error.