For an existing idea, what exactly do i need to configure to run this project?

[micelvrice]

Please judge whether my thinking is correct or please point out the problems：

1. rewrite the file "prompt.json" in the "templates" folder
2. rewrite the file "seed_ideas.json" in the "templates" folder
3. modify related information in the latex/templatex.tex such as the structure of the paper and relevant references

i'm not sure what changes need to be made to the "experiment.py" and "plot.py". Do i need to implement my idea in code first?

[vferraz]

I also second that

I tried setting up my files many times, following the examples provided in the templates.

Every single time, I get errors like

Failed to evaluate idea impact_feature_engineering: 'means' Processing idea: hybrid_models_game_theory Failed to evaluate idea hybrid_models_game_theory: 'means' Processing idea: cross_validation_techniques Failed to evaluate idea cross_validation_techniques: 'means' Processing idea: temporal_dynamics_in_games Failed to evaluate idea temporal_dynamics_in_games: 'means' All ideas evaluated.

My output JSON contains the key "means," I structured it in several different ways without success.

I have consumed over 50 USD and spent several hours trying to run something that hasn't worked, and no clue is given about what is wrong. Apart from that, I dealt with other issues, which I figured out by trial and error.

I don't know if I missed something in the instructions or how to set things up, but if the code requires mandatory types of data structure, inputs, outputs, etc., it would be interesting to communicate this information.

[conglu1997]

I also second that

I tried setting up my files many times, following the examples provided in the templates.

Every single time, I get errors like

Failed to evaluate idea impact_feature_engineering: 'means' Processing idea: hybrid_models_game_theory Failed to evaluate idea hybrid_models_game_theory: 'means' Processing idea: cross_validation_techniques Failed to evaluate idea cross_validation_techniques: 'means' Processing idea: temporal_dynamics_in_games Failed to evaluate idea temporal_dynamics_in_games: 'means' All ideas evaluated.

My output JSON contains the key "means," I structured it in several different ways without success.

I have consumed over 50 USD and spent several hours trying to run something that hasn't worked, and no clue is given about what is wrong. Apart from that, I dealt with other issues, which I figured out by trial and error.

I don't know if I missed something in the instructions or how to set things up, but if the code requires mandatory types of data structure, inputs, outputs, etc., it would be interesting to communicate this information.

Please judge whether my thinking is correct or please point out the problems：

1. rewrite the file "prompt.json" in the "templates" folder
2. rewrite the file "seed_ideas.json" in the "templates" folder
3. modify related information in the latex/templatex.tex such as the structure of the paper and relevant references

i'm not sure what changes need to be made to the "experiment.py" and "plot.py". Do i need to implement my idea in code first?

If you are hand-coding an idea for an existing template, you simply need to pass in an ideas.json file and you can skip the idea generation phase.

[conglu1997]

I also second that

I tried setting up my files many times, following the examples provided in the templates.

Every single time, I get errors like

Failed to evaluate idea impact_feature_engineering: 'means' Processing idea: hybrid_models_game_theory Failed to evaluate idea hybrid_models_game_theory: 'means' Processing idea: cross_validation_techniques Failed to evaluate idea cross_validation_techniques: 'means' Processing idea: temporal_dynamics_in_games Failed to evaluate idea temporal_dynamics_in_games: 'means' All ideas evaluated.

My output JSON contains the key "means," I structured it in several different ways without success.

I have consumed over 50 USD and spent several hours trying to run something that hasn't worked, and no clue is given about what is wrong. Apart from that, I dealt with other issues, which I figured out by trial and error.

I don't know if I missed something in the instructions or how to set things up, but if the code requires mandatory types of data structure, inputs, outputs, etc., it would be interesting to communicate this information.

Hi, if you are struggling to make a new template, I recommend commenting out the try except blocks so that the error messages will be more informative. You should also use a cheaper LLM for debugging, e.g. GPT-4o mini.

[othello1337]

GPT-4o mini Is not yet supported in this script