Reading list for research topics in embodied vision

Codebase of ACL 2023 Findings "Aerial Vision-and-Dialog Navigation"

Code for sim-to-real transfer of a pretrained Vision-and-Language Navigation (VLN) agent to a robot using ROS.

Official Implementation of IVLN-CE: Iterative Vision-and-Language Navigation in Continuous Environments

[ECCV 2022] Multimodal Transformer with Variable-length Memory for Vision-and-Language Navigation

Code for ORAR Agent for Vision and Language Navigation on Touchdown and map2seq

Code and utilities for creating a Vision-and-Language Navigation (VLN) simulator environment from a physical space.

Code for 'Chasing Ghosts: Instruction Following as Bayesian State Tracking' published at NeurIPS 2019

Official repository of "Mind the Error! Detection and Localization of Instruction Errors in Vision-and-Language Navigation". We present the first dataset - R2R-IE-CE - to benchmark instructions errors in VLN. We then propose a method, IEDL.

This repository contains completed assignments for the VLN computer programming 11 online course.

Contrastive-VisionVAE-Follower is a model used for multi-modal task called Vision-and-Language Navigation (VLN).