Improve cost estimates for jobs

expectedparrot / edsl

Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.

https://docs.expectedparrot.com

MIT License

194 stars 19 forks source link

Improve cost estimates for jobs #1235

Closed onmyraedar closed 3 weeks ago

onmyraedar commented 3 weeks ago

We now estimate the number of output tokens as output_tokens = math.ceil(0.75 * input_tokens), instead of setting them equal
We now take iterations into account when estimating job cost

I'd like to push a new EDSL dev version with these changes, so we can update the job estimate functions on Coop