WebGazer-based gaze keyboard
The WebGazer library needs an http server to run, so you can run python -m http.server --bind 127.0.0.1
in the same directory of integrated_sequential.html or basic_keyboard.html (It might also work without one, so you could try opening integrated_sequential.html or basic_keyboard.html directly without starting a server). What worked for some people was running python -m http.server [port number here]
in the directory of integrated_sequential.html and then putting http://localhost:[port number here]/integrated_sequential.html
into the search bar.
How to use integrated_sequential.html:
- Wait for the camera to load in the upper-left. Tracking dots should appear at key points on your face.
- Calibrate by moving the mouse cursor anywhere on the screen, looking at, and clicking to add a datapoint. It might help to click a handful of times in the same spot before moving to another spot.
- Move the cursor with your eyes to select a set of characters, then look at the desired character! A box will be 'selected' when the translucent box inside it fills up all of the way.
How to use basic_keyboard.html:
- Wait for the camera to load in the upper-left. Tracking dots should appear at key points on your face.
- Calibrate by moving the mouse cursor anywhere on the screen, looking at, and clicking to add a datapoint. It might help to click a handful of times in the same spot before moving to another spot.
- Move the cursor with your eyes to select a letter, or look at the left and right bars on the sides to scroll through the letters! A letter will be 'selected' when the translucent box inside it fills up all of the way.
Tips:
- Try adding calibration points for all regions of the screen! For example, make sure to hit all sides, all corners, and somewhere in the middle. We've found success with at least 8-10 different datapoints.
- It helps to take your glasses and mask off (if it is safe to do so!), place your laptop on a table, and sit with your head in a relatively stable position.
- Note the special characters in the bottom right selection - you can even use backspace and space!