search

google / langfun

OO for LLMs
Apache License 2.0
100 stars 17 forks source link

Add `num_requests` to `lf.LMSamplingUsage`. #235

Closed copybara-service[bot] closed 1 month ago

copybara-service[bot] commented 1 month ago

Add num_requests to lf.LMSamplingUsage.

This allows users to also track number of requests made to models with lf.track_usages context manager.