search

jigargajjar55 / Audio-Speech-To-Sign-Language-Converter

A web based application which accepts Audio speech or Text as input and converts it to corresponding Indian Sign Language for impaired of speaking or impaired of hearing and deaf people.
MIT License
93 stars 40 forks source link

readme

Audio Speech To Sign Language Converter

A Web Application which takes in live audio speech recording as input, converts it into text and displays the relevant Indian Sign Language animations.

  • Front-end using HTML,CSS,JavaScript.
  • Speech recognition using JavaScript Web speech API.
  • Text Preprocessing using Natural Language Toolkit(NLTK).
  • A 3D animation of a character created using Blender 3D tool.

Project Demo Video: https://youtu.be/YiHhD0QGrno

Prerequisites

  • Python >= 3.7
  • Browser supports Web Speech API
  • Download all required packages for python script A2SL/views.py

Installation Guide:

These instructions will get you download the project and running on your local machine for development and testing purposes.

Instructions

  1. Open the Downloads folder and then open the terminal.
  2. From the terminal, run the python file using the command "python manage.py runserver ####" (#### optional port number).
  3. From the terminal, it shows localhost address (looks like this "server at http://127.0.0.1:8000/") run on browser.
  4. Sign up and start exploring.
  5. Click on mic button to record speech.
  6. Speech is going to processed and respective animated outputs are shown accordingly and it also support entered text manually.