search

squeak-today / backend

story generation and REST API
2 stars 0 forks source link

json output for cohere #6

Open connortbot opened 2 days ago

connortbot commented 2 days ago

description

Have Cohere outputs explicitly provide a title

details

Add as extra field in response JSON in S3 (and thus API)

connortbot commented 2 days ago

This might not be ready without a fine-tuned model. There are multiple issues: A. Aya is incapable of using json_schema outputs. B. When json_schema is used, the title will sometimes be duplicated in the title field and the story field. C. Runaway happens at an unacceptable 20%+ rate.