phetsims / paper-land

Build and explore multimodal web interactives with pieces of paper!
https://phetsims.github.io/paper-land/
MIT License
10 stars 1 forks source link

Replace Camera with Scenery Display to support Virtual programs #221

Open brettfiedler opened 3 months ago

brettfiedler commented 3 months ago

We will be prioritizing enhancing the virtual experience. One solution we discussed in design meeting was to revamp the Camera screen itself to allow users to swap between the physical+virtual+camera or the virtual-only experience.

Ideas and mockups to go into this issue.

@brettfiedler to detail out needs for two-state screen and provide mockups

brettfiedler commented 3 months ago

If we're replacing the current camera interface with a scenery display, we need to consider how we switch between the camera and virtual display, and how we ensure current features related to the preview programs and to camera calibration are retained/integrated. The biggest question I have is: Which features are best to integrate into a scenery display for reduced complexity and maintenance? Which are best left in the React framework?

Preview Program Features in Sidebar

Camera Detection Features in Sidebar

Space Management Features

Misc Features

Simplest Change to Camera

The simplest change would involve leaving as much of the React interface intact and replacing only the camera feed/area around the camera feed with a scenery display. Adding/removing Programs, markers, etc would exist as they are in the sidebar. I'm not sure how much complexity this adds in connecting the react components to the scenery display.

image

image

More complex and integrated display

We could also try embedding more of the sidebar into the display. There's been interest in a "drag-n-drop" interface for papers, so this could be placed in the display itself. Then Preview Markers and whisker enabling could also appear there.

image

image

image