Skip to content

πŸš—πŸ—£οΈπŸ“‘πŸ—ΎπŸ A framework for navigation tasks that can build the 3D scene graph in real-time and utilize large language model (LLM) to guide the robot.

License

Notifications You must be signed in to change notification settings

YuZhong-Chen/LLM-Navigation

Repository files navigation

🏁 Navigator: Robo-Guide for Your Room!

documentation_link

🌟 A framework for navigation tasks that can build the 3D scene graph in real time and utilize a large language model (LLM) to guide the robot.

πŸ… This project won third place in the AMD Pervasive AI Developer Contest 2024 (Robotics AI).

πŸ”₯ Features

  • Real-time construction of a 3D scene graph with open-set segmentation capabilities.
  • Outputs the scene graph in a human-readable format.
  • Designed with a user-friendly interface.
  • Provides integration with ROS (Robot Operating System).

πŸ“˜ Documentation

If you want to test our program, we provide detailed documentation πŸ“„, and all the necessary dependency packages are included in Docker. This allows you to set up the environment and start your journey quickly.

⚠️ Prerequisites

  • Ubuntu
  • Docker and Docker compose
  • Visual Studio Code with the DevContainer extension

πŸ› οΈ Installation

You can find the instructions here.

⚑ Quick Start

Please refer to the Manual.

πŸ“ˆ Result

πŸŽ₯ Demo Video

Real World Demo

About

πŸš—πŸ—£οΈπŸ“‘πŸ—ΎπŸ A framework for navigation tasks that can build the 3D scene graph in real-time and utilize large language model (LLM) to guide the robot.

Topics

Resources

License

Stars

Watchers

Forks