Suggestion: Masking & Compositing

Since filters are already implemented, it would be neat to use the same slot in the camera to create masks/mattes so that compositing may be done. I'm neither an expert, nor even really all too knowledgeable about how this works so I'm probably getting steps wrong or missing some entirely, but hopefully the general idea gets through.

Setup a scene with a black background:

Then take a picture with a long exposure time to get a clean mask (I cleaned this up in photoshop because I took a horrible photo, but the point still stands):

Then copy the image onto a pane to craft a plate:

Insert plate into camera:

and some other steps later... you can do some cool stuff with this such as compositing a train onto another picture:

Thanks for the suggestion. It's an interesting idea, but I have mixed feelings about this. Firstly, even though it could be an interesting mechanic, I think it fall a bit outside of the scope of this mod. By doing things like this, we can easily fall into the rabbit hole of ideas and suggestions that stop probably only at the latest digital cameras with 16k video recording and a Photoshop implemented inside of Minecraft. Adding depth to the mod is okay, but it should stay as only the mechanic inside of the game, not separate game on top of the game itself. Above text is a bit of an exeggeration, but it should give you some insight on how I think about mod design in general. The main point is - simplicity is the key.

But even if we ignore the above, there are other things: It's not really clear how exactly should it work. Especially in the "some other steps later". Besides considerable effort required to code this, there are other questions that need to be solved: How do we get desired mask without some kind of painting system? I don't think it is possible to get a good mask with only shutter speed and different blocks.

As I understand it, compositing in film photography was done on the printing stage, not in camera. For the gameplay purposes it can be made to be in camera, but it's not completely logical. Should it work if we just stick the image in front of the lens? Even though the mod's camera does not have a depth of field to blur the image, it would still be almost black because there would be no light access to in from inside.

That's the first things from the top of my head, but there probably many more details left unresolved about the mechanic.

The lest filter expansion itself is interesting though, i'll note this.

You're right, my explanation was lacking. I was referring to the Williams process: https://en.wikipedia.org/wiki/Williams_process Now obviously that applies to video, but the same works for individual images as well. It involves capturing a subject in front of a black background and repeating exposures until a clean matte has been made.

I actually sort-of achieved this in game by taking a picture (1sec exposure) of an armor stand in front of some black concrete, developing it, then placing it on a wall and taking a picture of the picture, and then once more to get the background blacker and ended up with a nice result. So, with some effort it can be done in-game.

I suppose what I was trying to say is that this matte (not the printed version of it but the negative so that the light being let through is everything except the armor stand matte), could be placed into the filter slot and when your desired background picture is taken you get this:

This is the correct exposure of the armor stand and what will be composited in the final product:

Then expose the armor stand onto the unexposed sections of the background image to get something like this:

What can be done in game currently:

Creating a matte (albeit a bit difficult to get things lined up and not drifting around)
A filter slot that alters the image taken

What would have to be implemented:

Apon placing a matte 'plate' into the camera and taking an image: A pixel on the bufferedImage is blacked out if the corresponding pixel on the matte is below a black value threshold (as it'd be difficult to get perfect blacks in game). Then once all the pixels are compared with the matte it returns the bufferedImage with the required pixels being blacked out.
And this is the thing you're likely to disagree with as it goes against the simplicity and scope of the mod, which I completely understand: A way to re-expose an already taken negative (or 'combining' two images). Whether it stays in the camera, or a block like the lightroom, this is probably the most crucial thing. The easiest way to handle this for matting, is to simply copy the pixels that are not black over to the second image.

Obviously, this is a fairly niche and overcomplicated process, but this is just an example of something possible with being able to re-expose film. Other applications could include double exposures that leave the ghostly image on top of another like those 80s floating head portraits, or lightening/darkening images, ect.

Interested to see your thoughts on this.

Edit: Reading this back over I realize that yes, either the white or black sections of the matte would have to be cut out to allow light in. Glass pane + shears? Or perhaps it's not too important and that's getting pedantic for the sake of accuracy?

The concept is definitely interesting, i'm a bit surprised that the decent mask can be produced by taking picture of a picture. For some reason I didn't think that would work acceptably.

But yeah, you're right, it's still a "fairly niche and overcomplicated process", and it would require a substantial amount of work.

I've actually wanted to make double exposures possible, but quickly discarded that idea because it would require some kind of frame selector control in UI to choose what frame you want to expose, which would be quite a challenge to make it intuitive and not confusing.

Another good example, I think, is that for the most of development process you could release the shutter even if no film was inserted. It was changed very close to the release. Even though it was realistic (at least I think it is for most film cameras), I decided against it in favor of simplicity and clarity. I had several occasions when I wandered why the camera isn't working properly (when debugging something) and it turned out that no film was inserted, or roll has ended. And I coded this thing, knowing how it works from the start. I can only imagine frustration of the new player when they would realize that shots they have taken were for nothing because no film was inserted.

And I don't think there is a way to make masking/compositing simple and intuitive. So yeah, that's my thoughts about it. Maybe some day, when the mod will have 10's of millions downloads and everybody would be making addons for it like for Create right now, someone will implement this in an addon :)

mortuusars / Exposure

Suggestion: Masking & Compositing #10