GreptimeTeam / greptimeai

greptime instrument sdk for popular LLM (LangChain, OpenAI, etc.)
Apache License 2.0
11 stars 1 forks source link

feat: support to trace async chat completion #79

Closed Anyc66666666 closed 6 months ago

yuanbohan commented 6 months ago

what about fill your test cases in https://github.com/GreptimeTeam/greptimeai-cookbook/pull/20, and make sure that two async chat.completions.create will take less time than two sync create?

We MUST NOT change the async features of users' methods, we just collect metrics and traces.