one API to get all user desktop data (local, cross platform, 24/7, screen, voice, keyboard, mouse, camera recording). sandboxed js plugin system. keyboard and mouse control
basically ability to spawn virtual display and audio device which contains an AI agent that runs screenpipe itself, so it performs actions based on your digital context
this agent would be a fork on your digital identity (e.g. a fork of your screenpipe data)
tasks:
ability to spawn many virtual display & audio devices in rust
running screenpipe in the virtual machine itself and it would capture screen & audio input/output of the agent (the agent could be voice based, eg. speaking with humans or other AIs and we would record his context into the fork)
ability to have this kind of hierarchy from the original human "main branch" and the AI employees forks
linear[bot]
commented
3 days ago
basically ability to spawn virtual display and audio device which contains an AI agent that runs screenpipe itself, so it performs actions based on your digital context
this agent would be a fork on your digital identity (e.g. a fork of your screenpipe data)
tasks: