I'm trying to fine-tune the model on non-CO3D data, and was wondering if pose and depth were normalized to some scale. Presumably the scale of CO3D and MegaDepth is somehow normalized so the network can learn. I notice in the code after reading depth CO3D normalizes it:
Thanks for your great work!
I'm trying to fine-tune the model on non-CO3D data, and was wondering if pose and depth were normalized to some scale. Presumably the scale of CO3D and MegaDepth is somehow normalized so the network can learn. I notice in the code after reading depth CO3D normalizes it:
depthmap = (depthmap.astype(np.float32) / 65535) * np.nan_to_num(input_metadata['maximum_depth'])
I do not see any function applied to translation scale.
Any clarification on what normalization is happening in CO3D, as well as how to apply it to other datasets would be greatly appreciated, thank you!