DanielCoelho112 / synfeal

Synfeal: A Data-Driven Simulator for Camera Localization
9 stars 1 forks source link

Combining the global features from PointNet with the local features from CNN #20

Closed DanielCoelho112 closed 1 year ago

DanielCoelho112 commented 2 years ago

Hi @miguelriemoliveira and @pmdjdias,

today I had an idea that we could explore: build a neural network that receives both the point cloud and gray image. A sketch of the architecture is the following:

image

Using the point cloud we can extract the global features and using the gray image we can extract local features. By merging both information, maybe we can achieve something...

Of course, before entering this we first need to explore both modalities individually, but this could be a good place to innovate.

DanielCoelho112 commented 1 year ago

This won't be implemented in the near future. Closing.