search

adithya-s-k / World-of-AI

WORLD OF AI : An open-source repository for AI-based projects 🚀, from beginner to expert level, helping contributors start their journey in Artificial Intelligence and Deep Learning. Our projects provide hands-on experience to real-world problems👨‍💻. Join our community and contribute to the development of AI-based solutions 👥.
https://www.cognitivelab.tech/
MIT License
93 stars 86 forks source link

[ML category based PROJECT PROPOSAL] #28

Open aman-kumar29 opened 1 year ago

aman-kumar29 commented 1 year ago

Project Request

Video Captioning with Deep Learning The Video Captioning with Deep Learning project focuses on developing a model that automatically generates descriptive captions for videos.

Field Computer Vision, OpenCV, and NLP
About Video captioning using deep learning
Github aman-kumar29
Email amankumar76814@gmail.com
Label Project Request

https://github.com/aman-kumar29

Define You

Video Captioning with Deep Learning

Description

The project involves training a deep learning model on a labeled dataset of videos paired with corresponding captions. The model will learn to understand the visual content and temporal dynamics of videos and generate meaningful captions that describe the video content accurately. The project will also include the development of a user interface for real-time video caption generation and evaluation of the model's performance.

Scope

Objectives

  1. Real-Time Caption Generation: Develop a user interface where users can upload videos, and the model generates captions in real time, providing a time-aligned description of the video content.
  2. Content Discovery and Recommendation: Video captioning models can be integrated into video recommendation systems, enhancing personalized video recommendations based on user preferences and interests.

Deliverables

  1. Will give a trained image captioning model which should be able to take an input video and generate a relevant and contextually appropriate caption that accurately describes the visual content.
  2. A user-friendly interface to interact with the model
  3. comprehensive documentation will be provided, including technical documentation and user guides which will clearly describe how to use the interface and how to generate the caption.

Timeline

Start Date: when assigned End Date: 10 August

Video Links or Support Links

  1. https://www.microsoft.com/en-us/research/project/msr-vdc-iccv-2013-video-to-text-challenge/ for the dataset. There is also ActivityNet Captions dataset.
  2. Also some research papers would be helpful in choosing and changing the architecture of the model
reshma045 commented 1 year ago

Hello, I'm GSSoC'23 Contributor. Please assign me this issue. I want to work on this and contribute to this.

aman-kumar29 commented 1 year ago

@reshma045 hello! would you also like to work on this?