search

SillyTavern / Extension-ScreenShare

Provides the screen image for multimodal models when you send a message.
GNU Affero General Public License v3.0
4 stars 0 forks source link
extension

readme

Screen Share

Provides the screen image for multimodal models when you send a message.

Works only if the last chat message is from a user.

How to install

Install via the SillyTavern extension installer.

https://github.com/SillyTavern/Extension-ScreenShare

Prerequisites

The latest staging version of SillyTavern is preferred.

Your browser must support ImageCapture API.

See: https://caniuse.com/imagecapture

How to use

  1. Make sure that you're using a multimodal model for Chat Completion APIs and have "Send inline images" enabled.
  2. Initialize the screen-sharing session by choosing "Screen Share" from the "wand" menu.
  3. Start chatting! Every last user message will include the screen image as an inline attachment.
  4. When you're done, choose "Stop Screen Share" from the "wand" menu. Changing a chat or stopping the track via the browser also stops sharing.

Important! Images are not saved and are not posted anywhere besides your API backend provider.

License

AGPLv3