Gaze Embeddings for Zero-Shot Image Classification

Code and gaze data for CVPR17 paper

Data

We provide the follwoing data for three different datasets (CUB-VW, CUB-SW, and PETS)

Gaze raw data
Gaze-based class embeddings of three types GH, GFG, and GFS
Image features extracted from GoogLeNet using Caffe

Code

We provide two projects:

Gaze data collection experiment written in C# using Tobii TX300 Eye tracker SDK. The experiment steps are described and explained in the paper
Structured Joint Embedding for Zero-shot learning implementation using python from Evaluation of Output Embeddings for Fine-Grained Image Classification paper