Shopify / tracky

The easiest way to do motion tracking!
MIT License
353 stars 24 forks source link

[Feature request] EV lock, WB lock, other resolutions #10

Open vfxturjo opened 12 months ago

vfxturjo commented 12 months ago

Such an amazing app! I was searching for something like this for a long time!

  1. Please add exposure control/exposure locking and white balance control/white balance locking... This will be so helpful for taking artistic and cinematic shots with finer control....

  2. Is it possible to implement something like this: on one side(backend) it will record everything that ARKit is recording (in 1920x1440), and in the front it is a 4k/other resolution camera, it will record in 4k/specified resolution but match the ARKit data and align properly?

  3. Is it possible to implement something like this: continuation of point 2 plus the stabilization....?

vfxturjo commented 12 months ago

For proper documentation and ease of conversation, i am copy pasting the conversation here:

@BrennanLetkeman's reply on YouTube

  1. I'll have to look into it, this might be something we can control. good idea.
  2. do you mean a second physical camera? you can do this now - if you duct tape your iphone to a DSLR or whatever, you can use the recorded motion data with the other video, but you'll have to delta offset the blender camera to match the optical center of the non-iOS camera / lens view to sync them up.
  3. unfortunately I don't think so: stabilization changes the frame view inside a black box, so I don't think we know enough to also offset the virtual view data to match - at best (and it's sort of the same thing) you would take the raw video, make the comp, render those together, and then push that combined video through a stabilization app so the transforms effect the whole thing equally.
vfxturjo commented 12 months ago

my comment on YouTube:

  1. Yes please 😊
  2. No, i was saying about something like using 2 seperate threads (1 for ARkit analysis and data, 1 for default camera app in iphone which we are able to record in 4k or 12bit data) they will run at the same time to match timing... Is it possible? If possible, it will require a one-time work of finding offset among (ARkit camera data and main camera 4k video)... And yes, from 3, i now understand stabilization will make the track mismatched. So the main camera thread (equivalent to default camera to enable 4k) will have stabilization turned off... So we get best of both world (track + vid resolution) Sorry for my bad English, If my words are confusing, please tell me to clarify more.
  3. i understand. your way is good. offers better flexibility <3