SakanaAI / AI-Scientist

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬
Apache License 2.0
8.27k stars 1.16k forks source link

The segmented paper template allows weak LLMs to write articles #114

Open vasiliyeskin opened 2 months ago

vasiliyeskin commented 2 months ago

It is quite difficult for weak models to do so based on the default template, as one error in replaced text can lead to termination of editing in the SEARCH/REPLACE mode. Splitting the text into segments and enabling "whole" mode editing helps solve this problem.

The approach was tested on the "2d_diffusion" task using the "groq/llama3-8b-8192".