Closed keke-2000 closed 9 months ago
Hi Keke, Very glad that you liked our work.
Hi,Fanglin Bao: Congratulations to your lab for doing so well in this area. I read your article and code carefully, which gave me a lot of inspiration for my project "Texture enhancement of thermal infrared images". However, since there are not many public data sets in the scenario that my research is adapted to, I have been thinking about using blender to make synthetic data. Coincidentally, I found that your experimental data also has synthetic data based on blender. Although you gave a lot of details about the data, unfortunately, it seems that you did not give how to simulate with blender. I am really eager to know your method, I wonder if it is convenient for you to let me know?The details I want to know are: 1.blender involves attaching materials to objects, for example if I want to attach the material properties of aluminum to a block, then when I attach the material properties of the block, I need to attach the emissivity of aluminum to the self-emission properties of the block (so far this is how I think of it).But is his RGB attribute still needed? (including his RGB color, aluminum appearance, roughness, surface reflection value, etc.). 2.Then,how to obtain the gt of the image I obtained, such as vmap,emap,xmap, etc., used in Tex-Net. If you are willing to provide me with additional information, I would appreciate it very much and look forward to your reply
Hi,Fanglin Bao: Congratulations to your lab for doing so well in this area. I read your article and code carefully, which gave me a lot of inspiration for my project "Texture enhancement of thermal infrared images". However, since there are not many public data sets in the scenario that my research is adapted to, I have been thinking about using blender to make synthetic data. Coincidentally, I found that your experimental data also has synthetic data based on blender. Although you gave a lot of details about the data, unfortunately, it seems that you did not give how to simulate with blender. I am really eager to know your method, I wonder if it is convenient for you to let me know?The details I want to know are: 1.blender involves attaching materials to objects, for example if I want to attach the material properties of aluminum to a block, then when I attach the material properties of the block, I need to attach the emissivity of aluminum to the self-emission properties of the block (so far this is how I think of it).But is his RGB attribute still needed? (including his RGB color, aluminum appearance, roughness, surface reflection value, etc.). 2.Then,how to obtain the gt of the image I obtained, such as vmap,emap,xmap, etc., used in Tex-Net. If you are willing to provide me with additional information, I would appreciate it very much and look forward to your reply
Hi MeloHX, 1, you'll need to match Blender parameters to the physics properties. For example, RGB gives you 3 channels to render your interested data in your wavelength. RGB color and reflection are where you assign the self emission and reflectance values according to your physics model. You'll need to tune the surface roughness as you want, etc. 2, For ground truth eMap & tMap, you can assign a uniform color to the same material and render it. You'll need to post-process to map the color to your material index... We used the ground truth eMap and tMap to solve vMap.
Another problem is that after I attach a unique color to each material, the color on the object will change after rendering, and the same material will have different colors due to reflection and diffusion. In this case, how can I obtain the material index by reversely checking the color?
Another problem is that after I attach a unique color to each material, the color on the object will change after rendering, and the same material will have different colors due to reflection and diffusion. In this case, how can I obtain the material index by reversely checking the color?
Please set the ray depth = 0 to disable scattering. You can check the README file in this database for more details.
Hi Fanglin Bao: I would like to express my heartfelt congratulations and admiration for your outstanding work on research. I have been closely following your progress, and I must say it is truly impressive. I am writing to seek some assistance with a problem I encountered during the visualization process. Specifically, I have noticed that most of the TeX-GT images in my visualization are empty, appearing as completely black. Moreover, I have also observed the same phenomenon of empty TeX-GT images in the visualization results of the provided pre-trained models, particularly in the data located under the "supervised_synexp_r50_fold0_new_eval_visualized" . I am very curious to understand the underlying cause of this issue. I would be immensely grateful if you could provide some insights and explanations regarding this matter.
Hi Fanglin Bao: I would like to express my heartfelt congratulations and admiration for your outstanding work on research. I have been closely following your progress, and I must say it is truly impressive. I am writing to seek some assistance with a problem I encountered during the visualization process. Specifically, I have noticed that most of the TeX-GT images in my visualization are empty, appearing as completely black. Moreover, I have also observed the same phenomenon of empty TeX-GT images in the visualization results of the provided pre-trained models, particularly in the data located under the "supervised_synexp_r50_fold0_new_eval_visualized" . I am very curious to understand the underlying cause of this issue. I would be immensely grateful if you could provide some insights and explanations regarding this matter.
Thanks! Can you load the 'empty' images and check the exact data value? We mainly work with the data values in the image files. I believe it is caused by the image format. Sometimes when you output values like 0.1 to a PNG image which only takes 0~255 integers, it will become black.
Hi, FanglinBao: Thank you very much to your lab for coming up with such groundbreaking results, which gave me some ideas that I can't wait to move forward with. After carefully reading your article, I currently have some questions and needs regarding the details in the supplementary material: