Client stats - Githubissues

CarperAI / cheese

Used for adaptive human in the loop evaluation of language and embedding models.

MIT License

303 stars 24 forks source link

Closed shahbuland closed 2 years ago

shahbuland commented 2 years ago

Should have client manager save stats on the users. Specifically, for each user:

How much have they labelled so far
What proportion of data do they "error"
How much time do they spend labelling data on average after it has been sent to them