Briiick - Add Summarization - Githubissues

anthropics / anthropic-cookbook

A collection of notebooks/recipes showcasing some fun and effective ways of using Claude.

MIT License

6.74k stars 854 forks source link

Briiick - Add Summarization #77

Closed Briiick closed 2 months ago

Briiick commented 3 months ago

Adding draft for Summarization skills workflow. Looking for comments.

A outline of the project can be found at the top of guide.ipynb.

A few potential improvements I'm tracking right now (pending comments):

Figure out a way to actually show an eval picking out a missing bit of a summary (maybe just remove a portion of the summary and see if it notices?)
Test data - maybe have to use something from 2024 so it’s not part of the pretraining data…
few shot example in the grading eval?