Closed yonromai closed 1 year ago
Note: As far as I know, the model and all features, except the ChatGPT based ones, are deterministic
Nice! We don't need to worry about ChatGPT determinism, since our caching layer might create determinism and we likely will not use the ChatGPT features in the final model right?
This PR:
Note: As far as I know, the model and all features, except the ChatGPT based ones, are deterministic. I looked into making the ChatGPT features deterministic but from what I got from their API doc, it's not possible to set a random seed from the API (the only way to affect the randomness is to set model parameters like the temperature, but this also affects the behavior of the model).
cc @dhimmel