whitead
commented
2 days ago - Generalizes context to be multipart messages
- Allows multimodal contexts
- Enables caching control on messages
- Adjusts flow to allow context to be either packed into system prompt or some separate part of query, so that it can be cached