skywolf829 / GSTK

Gaussian Splatting toolkit application. One stop shop for preprocessing your dataset, training your model with human-in-the-loop training, and editing saved GSplat PLY files.

MIT License

4 stars 1 forks source link

Camera model #9

Closed skywolf829 closed 7 months ago

skywolf829 commented 7 months ago

In the backend, a camera model should be used to represent the user's view into the scene during training/editing. The camera will be interacted with via the user using their mouse/keyboard in the frontend viewer, and will send messages for how they'd like to move in the scene.

Requirements

Hold a persistent camera model that views into the scene
Camera should also hold the resolution to render the scene, and should listen for messages regarding the resolution change
Listen for messages about activity within the viewing screen for WSAD + mouse or mouse + modifiers, scrollwheel
Implement standard 3D viewer transformations to affect the camera model. For example, scrollwheel zooms on lookat target, click and drag rotates around lookat, shift/control + drag translates along camera x/y axis, etc. WSAD + mouse can also be implemented like a video game.

skywolf829 commented 7 months ago

Backend now has a render_cam in the ServerController object which is the users view into the scene. See /src/backend/dataset/cameras.py for the RenderCam object I created to use. Has proper device checking. Camera settings are accessible via RenderSettingsWindow, communication for this is already setup between front and backend.

TODO

Implement panning/rotating/zooming in backend and frontend

skywolf829 commented 7 months ago

Added panning/rotating/zooming with arcball model:

Rotate: click (left mouse only) and drag
Zoom: mousewheel
pan: shift + click (left mouse only) and drag

Haven't tested on a laptop yet, but the left click and zoom functionalities (and shift modifier) shouldn't be a problem. Will open new bug ticket if it is confirmed to be an issue.