search

MohammadrezaPourreza / Few-shot-NL2SQL-with-prompting

MIT License
305 stars 61 forks source link

Cost of each experiment #5

Closed nooralahzadeh closed 11 months ago

nooralahzadeh commented 1 year ago

Hi, Thank you for providing your code. It would be helpful if you could include the cost associated with each of your experiments for the Openai call in your paper. This way, others can obtain a rough estimate of the costs involved.

Thanks

MohammadrezaPourreza commented 1 year ago

Hi, That's a great point, thank you for pointing that out. We didn't pay anything for the CODEX model, since it was free when we were using that but for the GPT4 model the cost of running the 1034 queries of the DEV set was roughly 300$USD.