ManojKolpeThesis - Semantic segmentation using temporal fusion
Semantic segmentation is the process of labelling each pixel in a RGB image. In general setting, for a video sequence data semantic segmentation is performed on all the frames of the video or on the key frames without fusing the information from the previous frames. The overlapping information from the past frames can be utilized to make the prediction better. This work aims to understand the fusing of information from the previous frame to the current frame predition with the help of Gaussian process and Long Short Term Memory.
Model prediction
Plotting of translation and quaterions (rotation matrix) extracted from the android phone
Deployment of model in the android device (Oneplus 7,GM1901,Snapdragon 855,6GB RAM)
Source code - Code
References
Android
[1] https://github.com/PyojinKim/ARCore-Data-Logger
[2] https://ksimek.github.io/2012/08/22/extrinsic/
[3] https://automaticaddison.com/how-to-convert-a-quaternion-to-a-rotation-matrix/
[4] https://www.youtube.com/watch?v=zjMuIxRvygQ
[5] https://www.youtube.com/watch?v=lVjFhNv2N8o&list=PLYm0s3jier_Se9_HKG1X6rQrKFxYo8x2-&index=22