Code Monkey home page Code Monkey logo

mk205_altruist_sih2020's Introduction

Altruist Logo
SMART INDIA HACKATHON 2020

Team Altruist


We empathise to empower - realising the dream of Aatmanirbhar Bharat

Gitter

Tetra ameliaVisually ImpairedSpeech/Hearing ImpairedDementiaVoice Assistant Video Call

Problem Statement

Ministry/Organization Name - Ministry of Rural Development

Problem Statement - Making websites meaningful for differently Abled citizens with open source tools.

Understanding The Problem Statement

  • Ministry of Rural Development is currently running several schemes and programs primarily focusing on the development of rural poor. It is important to note that as per census 2011 (2016 updated) – In India out of the 121 Cr population, 2.68 Cr persons are disabled and (69%) of the disabled population resided in rural areas (1.86 Cr). One more key concern is that around 51% of the total disabled population in rural areas is not literate.

  • It thus becomes important that websites be made compliant towards the requirements that cater to needs of the differently abled citizens to bridge the huge talent leakage it might be causing.

  • Features to be introduced in website that empathise and synchronize with the rural audience and how they can enjoy the benefits with even minimal Digital Literacy.

Implemented on local Rural.nic.in View Demo

Altruist Logo

Our features integrated on the main website of the Ministry of Rural Development.

Altruist Logo

Sign Keyboard integrated on the main website of the Ministry of Rural Development.

Altruist Logo

Landing page of Text to Sign Converting Model

Altruist Logo

3D Text to Sign Converting Model in action

Altruist Logo

Head tracking, Speech Synthesis & Facial expression recognition on Covid-19 Updates Page.

Altruist Logo

Reminder on dementia page

Altruist Logo

AI Chatbot for Covid-19 updates.

Altruist Logo

Landing page for visually impaired.

Altruist Logo

Bifurcation webpages to address different disabilities.

Altruist Logo

Voice assisted Video Chat

Solution

We will be creating a Landing page which will distribute our audience and it will lead to different sections specific to a disability. We have identified and worked for some of the common disabilities possible in a person to make their Web experience more accessible, smoother and easier.

1. Tetra Amelia : View Demo

  • Head tracking & Facial expression recognition using webGazer & bodyPix.
  • Real smooth UI/UX for the people suffering from Tetra Amelia
  • Speech to Command facility for the website traversal
  • Speech synthesis for more accessible website experience.
  • Voice-Assisted Video Chat

2. Visually Impaired : View Demo

  • Speech to Command for easier website traversal.
  • Graphics that support color blindness.
  • Web scrapping for the content present on the page.
  • Speech synthesis for narrating the content present throughout the website.

3. Speech impaired/Hearing Impaired : View Demo

  • Creating an interactive model based on the HamBurg Notation and SiGML implementation.
  • Sign language keyboard for sending and receiving messages [WIP}
  • Sign language instruction / illustration helping in traversal of the Website.
  • Communication with Government Officials.
  • Using CNN & Keras model for developing sign to text.

4. Dementia :View Demo

  • *AI Chatbot based on NLP Dialogflow.
  • Sequencial reminder of the main purpose of visit of end-user.
  • Visual Imagery for easier selection and traversal through website
  • An extremely simple and easy to use website for easier synchronization with the brain.

5. Voice Assisted Video Call App View Demo

Refrences

  • Recent Developments in Indian Sign Language Recognition: An Analysis by Daleesha M Viswanathan , Sumam Mary Idicul ( (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 6 (1) , 2015, 289-293)
  • A Vision Based Recognition of Indian Sign Language Alphabets and Numerals Using B-Spline Approximation by Geetha M (International Journal on Computer Science and Engineering (IJCSE))
  • Handling Big Datasets for Machine Learning (Blog) by Matthew Stewart, PhD Researcher
  • Indian Sign Language Research and Training Centre (ISLRTC) http://www.islrtc.nic.in/
  • Twelfth International Multi-Conference on Information Processing-2016 (IMCIP-2016) HamNoSys to SiGML Conversion System for Sign Language Automation Khushdeep Kaur and Parteek Kumar

Open Source Tools Used

  • WebGazer
  • BodyPix
  • PoseNet
  • Handtrack.js
  • Jeeliz FaceFilter
  • TensorFlow.js
  • HandsFree.js
  • Peerjs

Made With ❤️, by Team Altruist

mk205_altruist_sih2020's People

Contributors

sharad2307 avatar prajwal2100 avatar mritunjaysharma394 avatar sraghuvanshi avatar rex12543 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.