Skip to content

An experiment on gaze tracker system, based on OpenCV, which shows how to control mouse pointer using eyes and gaze estimation

License

Notifications You must be signed in to change notification settings

luca-ant/gaze_tracker

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

52 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Gaze tracker

This project is an experiment on gaze tracker system, based on the position of glint on the iris, which is the reflection of a source of light located near the camera (See Purkinje images and Eye tracking for details). By tracking the glint it is possible to estimate the gaze position on the screen and use this position as an input system (in this example it is used only to move the mouse arrow).

Hardware requirements

For this kind of system, an high resolution image of the eye is required and a source of light near the camera too, so to get that with simple hardware I use a smartphone as a remote camera (achieved by IP Webcam app) fixed on a stable support, turn on the flash LED and put it in front on one eye, close to it.


Demo

Calibration phase

Mouse control phase

Getting started

  • Clone repository
git clone https://github.com/luca-ant/gaze_tracker.git
  • Install dependencies
sudo apt install python3-setuptools python3-pip python3-venv

or

sudo pacman -S python-setuptools python-pip python-virtualenv
  • Create a virtual environment and install requirement modules
cd gaze_tracker
python3 -m venv venv
source venv/bin/activate

python3 -m pip install -r requirements.txt

Running

Simply move to gt folder and run main.py

cd gt
python main.py

About

An experiment on gaze tracker system, based on OpenCV, which shows how to control mouse pointer using eyes and gaze estimation

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages