Add comparison of time/money costs of our approach vs. manual review by clinicians

neurogenomics / gpt_hpo_annotations

🏥🧑‍⚕️✨🤖✨👨‍⚕️🏥

https://neurogenomics.github.io/gpt_hpo_annotations/

GNU General Public License v3.0

1 stars 0 forks source link

Add comparison of time/money costs of our approach vs. manual review by clinicians #14

Closed bschilder closed 1 month ago

bschilder commented 2 months ago

Total costs for using OpenAI API: $296.27

bschilder commented 2 months ago

@KittyMurphy do you have a rough idea of how many hours it took to run the API to collect all the annotations? Or maybe just an estimate of time/query (with X phenotypes) and we can then extrapolate from there.

KittyMurphy commented 1 month ago

~100 phenotypes per hour.

bschilder commented 1 month ago

Perfect, thanks!

bschilder commented 1 month ago

quick question, 100/hour seems slow for a programmatic approach. is this due to OpenAI's API rate limit?