π A framework for navigation tasks that can build the 3D scene graph in real time and utilize a large language model (LLM) to guide the robot.
π This project won third place in the AMD Pervasive AI Developer Contest 2024 (Robotics AI).
- Real-time construction of a 3D scene graph with open-set segmentation capabilities.
- Outputs the scene graph in a human-readable format.
- Designed with a user-friendly interface.
- Provides integration with ROS (Robot Operating System).
If you want to test our program, we provide detailed documentation π, and all the necessary dependency packages are included in Docker. This allows you to set up the environment and start your journey quickly.
- Ubuntu
- Docker and Docker compose
- Visual Studio Code with the DevContainer extension
You can find the instructions here.
Please refer to the Manual.