CarperAI / cheese

Used for adaptive human in the loop evaluation of language and embedding models.
MIT License
300 stars 24 forks source link

Need to move communication with user to API #6

Closed shahbuland closed 2 years ago

shahbuland commented 2 years ago

Currently relying on client to implement some form of communication (i.e. send/receive jsons) with the user. For CHEESE to be a tool this isn't ideal. Whoever is using the API should have direct access to these JSON packets, but the current API provides no way to access them.

shahbuland commented 2 years ago

No longer a problem with coreographer design pattern