related-sciences / nxontology-ml

Machine learning to classify ontology nodes
Apache License 2.0
6 stars 0 forks source link

Enhance and test feature/model determinism #39

Closed yonromai closed 1 year ago

yonromai commented 1 year ago

This PR:

Note: As far as I know, the model and all features, except the ChatGPT based ones, are deterministic. I looked into making the ChatGPT features deterministic but from what I got from their API doc, it's not possible to set a random seed from the API (the only way to affect the randomness is to set model parameters like the temperature, but this also affects the behavior of the model).

cc @dhimmel

dhimmel commented 1 year ago

Note: As far as I know, the model and all features, except the ChatGPT based ones, are deterministic

Nice! We don't need to worry about ChatGPT determinism, since our caching layer might create determinism and we likely will not use the ChatGPT features in the final model right?