andyyankai / psdr-room

PSDR-Room: Single Photo to Scene using Differentiable Rendering (Siggraph Asia 2023)
25 stars 2 forks source link

run psd-room pipeline with customised image #18

Open ZheningHuang opened 1 month ago

ZheningHuang commented 1 month ago

Hi,

Thank you again for the excellent work. I'm very eager to use this for some related research.

I have a question about using custom images in the pipeline. I’ve reviewed all your previous responses on the topic, but I’m currently having trouble setting up the obj_stage_config.json file. While I understand the obj_init section, the other parts are less clear to me. For example:

"scene": {
    "wall": [
        63.77136900533217,
        -26.22863099466783
    ],
    "floor_height": -0.33570218086242676,
    "room_height": 0.06963715702295303,
    "room": {
        "scale": 0.7934396862983704,
        "transx": -0.31079724431037903,
        "transy": 0.1229747012257576,
        "rotate": 8.420150756835938,
        "ceiling_up": 0.0,
        "floor_up": 0.0
    },
    "floor_height_opt": -0.33570218086242676
},
"cameraFoV": 64.53305053710938,
"cameraPitch": -25.781124114990234,
"cameraRoll": -9.450427055358887

These parts seem confusing. The cameraFoV, cameraPitch, and cameraRoll parameters don't match the values in the camera.txt file.

Could you please provide guidance on how to properly set up this part? I know roomstage are not realized, but any advice on how we can integrate our own room stage results into this pipeline would be greatly appreciated.

Look forward to hearing from you.

Zhening

andyyankai commented 1 month ago

This should be the same value as camera.txt, as this is simply the output from prespective field. I would double check later.

cameraFoV, cameraRoll, cameraPitch = np.loadtxt(str(data_path / "camera.txt"))