Open tpsjr7 opened 1 year ago
I'm assuming this is an issue with GPT 3.5 that I don't see with GPT4. The current prompt may not be enough to convince GPT 3.5 to have the proper return values. I'll add some tests for GPT 3.5 and see if I can get it to work better! Thanks for mentioning this.
I installed cataclysm with pip today. I have a simple main.py
I can see that it called open api (3.5) and it generated the code and put it here datafiles/cataclysm/code/function_first_prime_with_3_digits.yml
When I step in the debugger, I can see that up to the
exec(code, ldict)
that the "code" variable looks like thisand the ldict has
{'_exec_return_values': None, 'args_in': (), 'kwargs_in': {}}
https://github.com/Mattie/cataclysm/blob/master/cataclysm/doomed.py#L83but after the exec, the
ldict['_exec_return_values']
evaluates to None instead of the expected value of 101.This happens with other functions I've tried.
I'm running Windows and python 3.11.2