nehavish006 commented 1 year ago

Project Request

Automatic captioning of videos based on cooking by understanding the action behind the scene and providing Nutrtional information based on the ingredients used.

Field	Deep Learning
About	Video Captioning Using CNN-RNN Model
Github	nehavish006
Email	nehavish006@gmail.com
Label	Project Request

https://github.com/nehavish006

Define You

GSSOC Participant Contributor - Snekha C | Contributor

Project Name

Description

Video Captioning is a task of automatic captioning a video by understanding the action and event in the video which can help in the retrieval of the video efficiently through text. Video Captioning is an encoder decoder mode based on sequence to sequence learning. Automated video caption generator helps searching of videos in websites better and make content easier. The video information is considered as a sequence of images with 10 to 12 seconds short video clips. In the proposed system, Convolutional Neural Networks (VGG 16) is used for feature extraction and LSTM is used for encoding and decoding the features. Greedy search algorithm is used for predicting the efficient caption and gives speedy word extraction. Finally, the language converter is used for specific people language to understand the captions.

Scope

Objectives:

To help the people with Deaf and hard of hearing individuals to watch videos helps people to focus on and remember the information more easily.
To build the feature extraction using the convolutional neural network (VGG 16).
To examine how LSTM is used for encoding and decoding the features.
To explore how the greedy search algorithm predict the efficient caption.

Deliverables:

A trained CNN RNN model capable of analyzing the video and generating the captions.
Well-documented guidelines, including dataset preparation, training, inference, and any specific requirements.

Timeline

Start date : The date of assignment End date: June 15 2023

Video Links or Support Links

Sandeep Samleti , Ashish Mishra , Alok Jhajhria , Shivam Kumar Rai, Gaurav Malik, 2021, "Real Time Video Captioning Using Deep Learning", International Journal Of Engineering Research & Technology (IJERT) Volume 10, Issue 12 (December 2021).

tushtithakur commented 1 year ago

Hi, I am very much interested and would like to contribute as a part of @GSSOC'23. Please assign the task to me. Thank you.

adithya-s-k commented 1 year ago

@nehavish006 I have assigned this particular project to you under GSSOC 23. Will you be able to manage the project alone or would you like to collaborate with other contributors

All the best contributing if you have any doubts on the project structure feel free to contact me

nehavish006 commented 1 year ago

Thanks for assigning this to me sir.I feel elated in contributing to open source community.I think that I can manage it alone sir.

With regards, Snekha C

On Sat, May 20, 2023, 10:12 PM Adithya S K @.***> wrote:

@nehavish006 https://github.com/nehavish006 I have assigned this particular project to you under GSSOC 23. Will you be able to manage the project alone or would you like to collaborate with other contributors

All the best contributing if you have any doubts on the project structure feel free to contact me

— Reply to this email directly, view it on GitHub https://github.com/CognitiveLab-tech/World-of-AI/issues/6#issuecomment-1555949291, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQNTX4MX3P3TBF5MIUQCAD3XHDX7NANCNFSM6AAAAAAYIY3VWQ . You are receiving this because you were mentioned.Message ID: @.***>

adithya-s-k / World-of-AI

[PROJECT PROPOSAL] #6