SakanaAI / AI-Scientist

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬
Apache License 2.0
7.91k stars 1.09k forks source link

The segmented paper template allows weak LLMs to write articles #114

Open vasiliyeskin opened 1 month ago

vasiliyeskin commented 1 month ago

It is quite difficult for weak models to do so based on the default template, as one error in replaced text can lead to termination of editing in the SEARCH/REPLACE mode. Splitting the text into segments and enabling "whole" mode editing helps solve this problem.

The approach was tested on the "2d_diffusion" task using the "groq/llama3-8b-8192".