Open muelli opened 4 months ago
I wonder how much sense it would make to support the Batch API as it would further lower the cost: https://platform.openai.com/docs/guides/batch/batch-api
I guess it would be a bit of an architectural change by polling for the answer every so often but maybe it's worth the effort.
I wonder how much sense it would make to support the Batch API as it would further lower the cost: https://platform.openai.com/docs/guides/batch/batch-api
I guess it would be a bit of an architectural change by polling for the answer every so often but maybe it's worth the effort.