irllabs / archive_socialvr-browser

1 stars 0 forks source link

"Rooms" with Video Background #107

Open apuhub opened 6 years ago

apuhub commented 6 years ago

Currently, SocialVR only allows a user to build experiences based on connecting 2D 360 images. We call these individual "rooms".

However, sometimes a user might want to include 360 video from their classroom or a field trip or a walk in the park.

If a user records a video on a 360 Theta S camera, they then need to convert it from spherical video to flat video using the Theta app.

After they have a flat video it will be saved as a mp4. This can easily be uploaded to youtube for viewing or viewed in the Theta app itself, but otherwise, there is not much more a user can do with it.

The user should be able to "select" a video from the files on their computer or "drag and drop" or provide a link from google drive into the room background.

Similar to the "Add 360 Photo" this should instead say "Add 360 photo or video, import, or link to google drive" screen shot 2018-04-18 at 11 12 31 am

Please see the test 360 videos: []https://drive.google.com/open?id=0B9xrGq3470WfZDVBbmJtWWlVSmM

Because these files are much heavier than 360 photos, is it possible to have these linked in an individual's google drive folder so the storage would be on their side instead of on our server? @batchku @0la0 @emilt27

A user must be able to "edit" or "trim" down to a one min selection from their clip in the browser.

screen shot 2018-04-18 at 11 32 33 am

This is a simple online trimmer example that includes a timecode : []https://www.kapwing.com/editor/trimmer

Another basic "edit" feature would be volume control.

After selecting the clip, it would only play in the background when the browser is in preview mode.

screen shot 2018-04-18 at 12 07 45 pm

Like other SocialVR experiences, a user can add hotspots including audio, 2D image, and text. They can also add doorways.

A user should be able to create a series of "360 video background rooms" (maximum 4 video background rooms) in a SocialVR experience.

A user should be able to create a combination of "360 video background rooms" and "360 photo background rooms" (maximum 4 "360 video background rooms").

Viewing the Experience In preview mode, when a user enters a "360 video background room" it will immediately start play. This video will loop continuously until a viewer moves to another room through a doorway.

If a user holds their gaze over a hotspot, the hotspot will be visible like in a standard SocialVR experience and the "background 360 video" in the room will continue to play. The audio in the video background will be muted if there is an "audio" hotspot.

When a user goes through a doorway and enters a new "360 video background room" it will start playing from the start of the selected clip.

Similarly if a user went from one "360 video background room" to a second "360 video background room" through a doorway before the first clip was complete, and then went back to the first "360 video background room" - the clip would start playing from the start and then loop.

apuhub commented 6 years ago

@emilt27 how can we try this now that we have firebase?