jxnl / instructor

structured outputs for llms
https://python.useinstructor.com/
MIT License
6.52k stars 514 forks source link

rename batch to bulk/async, to avoid confusion with OpenAI's batch APIs #765

Closed avyfain closed 2 weeks ago

avyfain commented 2 weeks ago

Small documentation update.

I was looking for pointers to using OpenAI's batch API but while the docs on the instructor side say "batch" they are about async/parallel execution. I might try to build a minimal example using the batch API in the next few weeks that can be added to the cookbooks, but this cleans up the docs a bit in the meantime.