search

zeno-ml / zeno-build

Build, evaluate, understand, and fix LLM-based apps
MIT License
484 stars 33 forks source link

Openai utils improvements #112

Closed neubig closed 1 year ago

neubig commented 1 year ago

Description

This makes two small improvements to OpenAI utils:

  1. It ups the rate limit from 50 calls/minute to 300 calls/minute by default.
  2. It uses client sessions to make calls more efficient

Blocked by