Create plan for workflow

[Scottapotamas]

Need to plan things out:

Work out which

• [x] language to use (rust?)
• [x] Input file type(s)
• [x] Output file type and format
• [x] Output file/folder structure for full output data
• [x] Work out how to stitch images together for editing after capture

[Scottapotamas]

Tasks & Functionality Required (ideally)

Ingests the 3d geometry data from Blender (or some more generic file type?) Uses a known camera pose in 6D space to provide backface culling functionality.

Generates the following:

• series of delta-compatible movements which are grouped by object in the 3d file.
• series of LED colours/sequences the delta should be drawing at those points in time
• exposure times for each group of objects, the camera will capture those as required?
• the target 6D pose of the camera for the given 'frame'.

These functions ensures that:

• geometry back faces aren't shown in the render (unless we want them).
• Each layer is rendered individually, allowing for 'brightest non-clipping light' to be used, and then those objects to be darkened in post.
• single exposures doesn't exceed X seconds (thermal noise and stray light mitigation).
• each object is on a different frame, which can later be blended together.
  • This reduces the amount of noise in the image substantially once stitched.

[Scottapotamas]

Image post processing

The end of an animation will result in a large flat folder of images:

1. Group images into folders corresponding with their 'frame' in the animation.
2. Group images into folders for the given objects/groups.
3. The images should now be sorted into a deeper tree. Possibly put these alongside the motion files?
4. Generate a series of openEXR images which contain each object/pass for a given frame.
5. Throw the exr sequence into AE (or some editing software) and then export video.
6. Optionally tweak/edit layers in the exr's as required.

See #5.