search

samkamau81 / AI4Education-Moringa

Applying AI in the Education Sector
1 stars 0 forks source link

MVP Page (CRITICALL !!!) #4

Open samkamau81 opened 1 month ago

samkamau81 commented 1 month ago

WhatsApp Image 2024-05-21 at 19 26 33_4d19396b

Using Django for our backend, come up with our MVP , an edtech app aims to provide specialized courses for deaf individuals by converting caption text from educational videos into sign language using AI and computer vision. This allows deaf users to learn as effectively as their hearing counterparts. The app employs Optical Character Recognition (OCR) to extract text from video captions, Natural Language Processing (NLP) to interpret the text, and sign language translation models to generate corresponding sign language gestures in real-time.

It has both Front End and very intensive Back-End which incorporates AI . Main Function is convert caption text to deaf avatar's hand movement.

samkamau81 commented 1 month ago

Close issue once completed

samkamau81 commented 1 month ago

Not found any ASL (American Sign Language) avatar for our use, we'll have to re-strategize. How will AI help the Blind ????

samkamau81 commented 1 month ago

I was thinking of creating a solution that enable the deaf communicate with a chatbot like chatgpt. This is kinda doable as compared to developing an avatar but that's part of the prospect where the avatar now commuicates whatever the chatbot outputs.

Let me provide links to the tensorflow illustrations:

samkamau81 commented 1 month ago

This is the Hello avatar, I managed to create

https://github.com/samkamau81/AI4Education-Moringa/assets/63351043/9cd3fa7f-a114-47e4-b501-1d5443712a1e

samkamau81 commented 1 month ago

Niaje Collo, Mind cloning this repo (https://github.com/sahilkhoslaa/AudioToSignLanguageConverter.git) and running it to see whether it is working properly. https://github.com/sahilkhoslaa/AudioToSignLanguageConverter?tab=readme-ov-file

Collins-Omariba commented 1 month ago

Niaje Collo, Mind cloning this repo (https://github.com/sahilkhoslaa/AudioToSignLanguageConverter.git) and running it to see whether it is working properly. https://github.com/sahilkhoslaa/AudioToSignLanguageConverter?tab=readme-ov-file

Done so, It runs but nothing major happens(audio recognition) . The screen is constantly displaying "Loading Please wait".