Closed deepak-akkil closed 1 week ago
Even with a temperature 0, the response can be very non-deterministic, sometimes to the extent that plans returned by the planner are different.
Setting a low top_p and a "seed" are additional steps that can be taken to move towards deterministic responses. https://cookbook.openai.com/examples/reproducible_outputs_with_the_seed_parameter
Even with a temperature 0, the response can be very non-deterministic, sometimes to the extent that plans returned by the planner are different.
Setting a low top_p and a "seed" are additional steps that can be taken to move towards deterministic responses. https://cookbook.openai.com/examples/reproducible_outputs_with_the_seed_parameter