Adding support for Prompt Caching

jamesrochabrun / SwiftAnthropic

An open-source Swift package for interacting with Anthropic's public API.

90 stars 29 forks source link

Closed jamesrochabrun closed 1 month ago

jamesrochabrun commented 1 month ago

Prompt Caching for (Messages, System, tools)
Updated Usage object to read:
- cache_creation_input_tokens
- cache_read_input_tokens

jamesrochabrun commented 1 month ago

cc @lzell for AIProxy changes :)