Tag Classification with Image and Information

[yoohj0416]

This is a set of steps for tag classification with image and IMU/GPS information.

• [x] Implement the ModalityType, which is the input type of ImageBind, to be able to convert IMU/GPS information to an embedding vector.
• [x] Find a way to combine the image embedding vector and the IMU/GPS information embedding vector.
• [x] Tag classification test with image and IMU/GPS information

In the tag classification with image and information experiment, the IMU/GPS information from BDD100K is converted to an embedding vector and combined with the image vector to perform classification.

[yoohj0416]

Scene classification with inertial information

• Classification is performed with embeddeding vector: <image feature> + <imu feature>