Skip to content

R4j4n/Neural-Keyboard

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

forthebadge
forthebadge
forthebadge

NEURAL KEYBOARD :

The neural keyboard is an Eye-controlled keyboard for physically-challenged people. It uses Neural Networks to predict the eye's state accurately using which the keyboard is operated.

Alt text

How it works

For each frame in a second:

  1. Using Dlib frontal face detector all of the 68 facial landmarks co-ordinates are detected and the co-ordinates are converted into numpy array.
  2. Pass 36,37,38,39,40,41th index of array to the crop_eye() function as it contains co-ordinates of respective landmarks and function returns cropped image for left eye.
  3. Similarly pass 42,43,44,45,46,47 index to get cropped image of right eye.

4. Pass the cropped eye images through the model for the detection of the eyes width.

This code was developed on:

python == 3.7.0
opencv-python == 4.3.0.36
tensorflow==2.3.0
dlib == 19.20.0
imutils==0.5.3

NOTE:

Download the shape_predictor_68_face_landmarks.dat file from HERE and paste it in the Files folder.

With the joint effort of: https://github.com/basnetrikesh

visitors