Client stats - Githubissues

CarperAI / cheese

Used for adaptive human in the loop evaluation of language and embedding models.

MIT License

300 stars 24 forks source link

Client stats #26

Closed shahbuland closed 1 year ago

shahbuland commented 1 year ago

Addressing #24 and #25

Summary of changes:

Add stats on clients with their total time spent on tasks, and total number of tasks completed
Add stats to API itself on how many tasks CHEESE has finished, how many clients are available, etc.
Add ability to terminate clients through API
Add timestamps to each BatchElement, marking when it was first received by a user from pipeline and when it was sent by user back to pipeline