evo-biomech / scAnt

open-source 3D scanning and processing pipeline
MIT License
173 stars 39 forks source link

Issue with Images in Meshroom #10

Closed sbasnagala closed 2 years ago

sbasnagala commented 2 years ago

Hi Fabian, Why background of cutout images are black? They supposed to be white? I ran this couple of times and every time, it would not go beyond 'FeatureExtraction'. Any ideas? Is this something to do with graphic card of the computer?

Here I attached a screenshot of the meshroom and code

MR1 .

Program called with the following parameters:

[11:43:51.002841][info] CameraInit report:

[11:58:29.033253][info] CUDA-Enabled GPU. Device information:

WARNING:root:Downgrade status on node "ImageMatching_1" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "FeatureMatching_1(0)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "FeatureMatching_1(1)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "StructureFromMotion_1" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "PrepareDenseScene_1(0)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(0)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(1)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(2)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(3)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(4)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(5)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(6)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(7)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(8)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(9)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "Texturing_1" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMapFilter_1(0)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMapFilter_1(1)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMapFilter_1(2)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "Meshing_1" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "MeshFiltering_1" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "FeatureExtraction_1(0)" from Status.ERROR to Status.SUBMITTED

[12:57:43.920472][info] CUDA-Enabled GPU. Device information:

WARNING:root:Downgrade status on node "ImageMatching_1" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "FeatureMatching_1(0)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "FeatureMatching_1(1)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "StructureFromMotion_1" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "PrepareDenseScene_1(0)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(0)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(1)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(2)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(3)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(4)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(5)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(6)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(7)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(8)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMap_1(9)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "Texturing_1" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMapFilter_1(0)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMapFilter_1(1)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "DepthMapFilter_1(2)" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "Meshing_1" from Status.SUBMITTED to Status.NONE WARNING:root:Downgrade status on node "MeshFiltering_1" from Status.SUBMITTED to Status.NONE

FabianPlum commented 2 years ago

Hi Suranga,

The background is supposed to be black (or any solid colour for that matter), as we want to prevent Meshroom from finding any features in there and solely focus on the scanned specimen.

It seems like your GPU may not have enough video RAM. I have not worked with this recent version of Meshroom yet, but normally, you should be able to select "force CPU extraction" so the descriptors can be computed outside your GPU.

All the best Fabi

sbasnagala commented 2 years ago

Thanks, I ran with CPU extraction selected. Here is a screenshot and a log where it stopped. Any idea what is going on, do you think it is still lack of graphics memory? What is "Found only 7/10 nearest cameras for view id: 2093211462"?? I deleted few images in the meshroom before ran the pipeline, because they did not have the solid background colors.. Is that the reason it is not detecting full range of stacked images?

MR2 ?

[17:26:13.598927][info] CUDA-Enabled GPU. Device information:

FabianPlum commented 2 years ago

The problem is that you likely don't have enough unique camera positions for a good reconstruction. For most reconstructions, I would advise to use at least 180 orientations or more. You are not going to get a great scan if you rotate the specimen just around the Y axis.

Perhaps pose these questions into the Meshroom Forums/GitHub for some additional pointers as I am not developing the Meshroom software myself.

sbasnagala commented 2 years ago

What software are you working with? May be I can download it and could you provide me the running/configuration instruction as well? That will be great!!

FabianPlum commented 2 years ago

I use both Meshroom and 3DF Zephyr Lite for our reconstruction, but I am not a developer of either software so I cannot provide tech support there.

Regardless of the software, you need a lot more orientations for the reconstruction! Try to use the full range of the scanner as it seems you are not rotating the X-axis here at all.

I'll now close the issue as your images are being read and processed.

All the best Fabi