Make it clear when a response is from cache

oughtinc / ice

Interactive Composition Explorer: a debugger for compositional language model programs

https://ice.ought.org

MIT License

529 stars 66 forks source link

Make it clear when a response is from cache #317

Open david-mears-2 opened 1 year ago

david-mears-2 commented 1 year ago

I think the interface should do either or both of: a) Make it clear when a response is from cache b) Show the correct cost ($0.00) for responses from cache

This would help users to track their costs correctly.