UppuluriKalyani / ML-Nexus

ML Nexus is an open-source collection of machine learning projects, covering topics like neural networks, computer vision, and NLP. Whether you're a beginner or expert, contribute, collaborate, and grow together in the world of AI. Join us to shape the future of machine learning!
https://discord.gg/tctW47VN
MIT License
58 stars 106 forks source link

ASL | Transfer Learning and Fine-tuning for Sign Language #675

Open Varunshiyam opened 2 hours ago

Varunshiyam commented 2 hours ago

Is your feature request related to a problem? Please describe.

Effective communication with the deaf community is crucial for inclusivity, but traditional methods often present barriers. This project aims to bridge this communication gap by developing a robust American Sign Language (ASL) recognition system using deep learning. The challenge lies in accurately classifying diverse ASL expressions from images to enable real-time translation and facilitate seamless communication.


Describe the solution you'd like

This project demonstrates the application of transfer learning to classify American Sign Language (ASL) expressions. Two popular CNN architectures, InceptionV3 and ResNet50, are employed as base models with pre-trained weights from ImageNet. The models are fine-tuned on an ASL dataset, leveraging their learned feature representations for improved accuracy. The training process includes data augmentation and employs the Adam optimizer with a categorical cross-entropy loss function. The performance of both models is evaluated and compared, showcasing the effectiveness of transfer learning for ASL classification and its potential for communication support applications.


**Kindly, Assign me this Issue Under:


Additional context

Screenshot 2024-10-30 at 4 15 26 PM Screenshot 2024-10-30 at 4 15 48 PM Screenshot 2024-10-30 at 4 16 23 PM
github-actions[bot] commented 2 hours ago

Thanks for creating the issue in ML-Nexus!🎉 Before you start working on your PR, please make sure to:

Varunshiyam commented 2 hours ago

@Neilblaze @SaiNivedh26 Kindly Assign me this Issue under Level - 3 , Gssoc-ext , hacktoberfest