Improve usage tracking.

google / langfun

OO for LLMs

Apache License 2.0

100 stars 17 forks source link

Closed copybara-service[bot] closed 1 month ago

copybara-service[bot] commented 1 month ago

Improve usage tracking.

Introdues lf.UsageNotAvailable for representing use cases in which LLMs do not support usage accounting.
lf.track_usages to support model filtering.
Add tests for lf.track_usages with multi-threading scenarios.