Skip to content
/ DAMR Public

Depth-aware Mixed Reality: Capture the AR-Flag

Notifications You must be signed in to change notification settings

mfaizanse/DAMR

Repository files navigation

Depth-aware Mixed Reality: Capture the AR-Flag

Description

This repository contains the implementation for the project: Depth-aware Mixed Reality: Capture the AR-Flag. The project's goal is to augment reality with a virtual object which can be interacted with by multiple people. It is split into multiple parts which are listed and whose progress is displayed in Progress. This project was done in the context of the lab course - perception and learning in robotics and augmented reality.

Progress

  • Depth Estimation and Camera Pose
    • Depth Map Filtering
    • Kinect Fusion Integration
  • User Interaction and Scene Manipulation
    • ChArUco Marker Tracking
    • Human Pose Estimation
  • Realism and Embedding
    • Augmented Rendering
    • Image Harmonization
  • (Extension) Multiplayer Game: Capture the plane

Dependencies

The project depends on the following libraries:

  • OpenCV with ArUco contrib module
  • Caffe
  • Pytorch
  • Pyrender

Project Demo

A video showcasing our implementation:

Demo of the implementation

The intermediate slides presenting the project can be seen here. For the final slides go here.