Skip to content

This project is part of the course CSE478: Digital Image Processing, Monsoon 2020, IIIT-Hyderabad. It classify beer labels using SIFT algorithm.

Notifications You must be signed in to change notification settings

mdv3101/Beer-Label-Classification-using-SIFT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Beer Label Classification

Project

The task of this project is to replicate the results from the paper titled Beer Label Classification for Mobile Applications. Here, we attempt to automatically identify beer types using SIFT-based image matching of bottle labels

Contents

Dataset

The dataset used for this project is created by scraping and manually downloading the images from Bing and Google.
The dataset directory structure is as follows:

images
  ├── database
  ├── query
  ├── samuel_adams
  | ├── database
  | ├── query
  • The database folder consists of images having clean labels.
  • The query folder contains images of beer bottles with the labels.
  • Each query image has a corresponding database image, i.e. each beer bottle has its corresponding clean label image.
  • The primary dataset consist of 100 database and corresponding 100 query images.
  • The samuel_adams folder consists of 30 database and corresponding 30 query images for the Samuel Adams brewery.

Prerequisite

Python = 3.6+

Setup

  1. Clone the repo to your local machine (~85 MB).
    git clone https://github.com/Digital-Image-Processing-IIITH/project-dipsum
  2. Move to the project directory.
    cd project-dipsum
  3. Install the required dependencies.
    pip install -r requirements.txt
  4. Create a folder for downloading/saving the descriptor file.
    mkdir lookup

Running the demo

Follow the following steps for running a quick demo using a single beer bottle image:

  1. Download the pre-computed SIFT descriptors from the given link (main_sift.pkl, ~69 MB) and save them in the lookup folder.
  2. Run the following command:
    python src/demo.py -l lookup/main_sift.pkl -q images/query/amstel_light.jpg
    You can use any query image from images/query/.

NOTE: This might take approximately 3-5 minutes on your personal laptops.

Running the code

There are two ways in which you can generate the results for all the query images:

  1. Execute the end-to-end code src/main.py. It will generate the SIFT descriptors for all the images in the images/database/. Then it will iteratively generate and match SIFT descriptors of the query images from images/query/ with the database image's descriptors. For this, run the following command:
    python src/main.py -load N

  2. Download the pre-computed SIFT descriptors from the given link (main_sift.pkl, ~69 MB) and save them in the lookup folder. For this, run the following command:
    python src/main.py

We also provide an end-to-end script for generating results on the Samuel Adams dataset. Similar to src/main.py, this can be done in two ways.

  1. Execute the end-to-end code src/samuel_adams_end2end.py. For this, run the following command:
    python src/samuel_adams_end2end.py -load N

  2. Download the pre-computed SIFT descriptors from the given link (samadams_sift.pkl, ~31 MB) and save them in the lookup folder. For this, run the following command:
    python src/samuel_adams_end2end.py

For src/main.py and src/samuel_adams_end2end.py we provide the following arguments:
-d path to the folder containing database images;
-q path to the folder containing query images;
-l path to the pre-computed descriptors file;
-load if Y/y, it will load the precomputed descriptors from the file provided using -l, or else, it will run the end-to-end code.

NOTE: Running these scripts might take more than a couple of hours on your personal laptops.

Results

Dataset No. Database Images No. of Query Images Accuracy(%)
Primary Dataset 100 100 100
Samuel Adams 30 30 100

Visualization

We have provided a python script to visualize the feature mapping using SIFT.
python src/sift_visualization.py

It takes two arguments:
-d Path to the database image
-q Path to the query image




Effect of Camera Motion

To study the effect of camera motion, an ipython notebook is provided CameraMotion.ipynb. Here we study how the camera motion affects the SIFT algorithm. The following graph summarizes the results obtained:

Effect of Distance

To study the effect of distance of beer bottle from the camera. Download the pre-computed SIFT descriptors from the given link (distance_sift.pkl, ~8.1 MB) and save them in the lookup folder. Run the following command:
python src/main.py -d images/distances/database/ -q images/distances/query/ -l lookup/distance_sift.pkl



About

This project is part of the course CSE478: Digital Image Processing, Monsoon 2020, IIIT-Hyderabad. It classify beer labels using SIFT algorithm.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published