Junda24 / AFNet

[CVPR 2024] Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Driving
MIT License
139 stars 8 forks source link

AF module in your code #17

Closed ZYDeeplearning closed 3 months ago

ZYDeeplearning commented 3 months ago

Where is the AF module in your code? I didn't find the corresponding code, only the output of two depth maps

Junda24 commented 3 months ago

Where is the AF module in your code? I didn't find the corresponding code, only the output of two depth maps

没有单独写一个module,但是在forward过程中有单目和多视角的depth residual的互相作用

ZYDeeplearning commented 3 months ago

image Is your ‘depth residual’ referring to this code in the screenshot? It seems to be before the regression estimate. In addition, where the code of the Mw confidence map is embodied is not well understood, thanks!

Hamusukesama commented 3 months ago

Where is the AF module in your code? I didn't find the corresponding code, only the output of two depth maps

没有单独写一个module,但是在forward过程中有单目和多视角的depth residual的互相作用

Same questions. The article says that 'we design the AF module to adaptively select the most accurate depth between the two branches as the final output', which indicates there is a module afterwards, to fuse the depth estimation of the two branches. However, I didn't see the code to do the fusion, using Ms, Mm, and Mw. Besides, is the confidence loss included in the training process? And will the code of 'patchmatch_fusion' be released?

Junda24 commented 3 months ago

Where is the AF module in your code? I didn't find the corresponding code, only the output of two depth maps

没有单独写一个module,但是在forward过程中有单目和多视角的depth residual的互相作用

Same questions. The article says that 'we design the AF module to adaptively select the most accurate depth between the two branches as the final output', which indicates there is a module afterwards, to fuse the depth estimation of the two branches. However, I didn't see the code to do the fusion, using Ms, Mm, and Mw. Besides, is the confidence loss included in the training process? And will the code of 'patchmatch_fusion' be released?

Sorry for the confusion, this module is designed for noisy poses and will be open-sourced together with the DDAD model soon.