Doesn't produce anything close to working code for example "cli snake game" given in readme

geekan / MetaGPT

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

https://deepwisdom.ai/

MIT License

43.93k stars 5.23k forks source link

Doesn't produce anything close to working code for example "cli snake game" given in readme #195

Open Benzidrine opened 1 year ago

Benzidrine commented 1 year ago

Cool idea. Thanks for creating it. Interesting to try it out. However the example given in the readme doesn't lead to working code. Unfortunately it tries to instantiate classes without providing necessary properties.

Using chatgpt4 and code review. Unfortunately it doesn't seem suitable for any task.

Note I don't think it is necessarily your fault. ChatGPT4 I think has gotten much worse.

voidking commented 1 year ago

Yes, we cannot guarantee that the generated code will work, it relies heavily on gpt. There is some work in the roadmap that may improve the success rate of the first run.