search

microsoft / botframework-sdk

Bot Framework provides the most comprehensive experience for building conversation applications.
MIT License
7.5k stars 2.44k forks source link

[Feature Request] Caching #6317

Open AdamSobieski opened 3 years ago

AdamSobieski commented 3 years ago

I would like to request a feature: caching dialogue system outputs. Such a feature would be useful for scenarios where natural language generation were expensive and for scenarios where dialogue systems generate audio or video content (see also: Skype Conversations Of The Future).

Cached output content (e.g. multimedia clips or segments) could be described as each depending upon data. Should these data change, the cached content would be invalidated.

If caching hypertext, audio, and video dialogue system outputs isn't yet facilitated by the Bot Framework, I would like to request the feature.

AdamSobieski commented 3 years ago

Clarifying, considering a large-scale multimedia Q&A scenario, if a question hasn't been asked before, a dialogue system would generate an answer and cache the resultant multimedia content with dependencies on all of the utilized data. Then, while that data remained unchanged, the dialogue system would utilize the cached multimedia content, providing users with the answer to the same question.

One could, then, also consider knowledgebases which can raise events (e.g., update-related), propagate changes, and otherwise interoperate with multimedia content caching systems.