An Open-Sourcing Localization Dataset Collected in Asian Urban Canyons, including Tokyo and Hong Kong
This repository is the usage page of the UrbanNav dataset. Positioning and localization in deep urban canyons using low-cost sensors is still a challenging problem. The accuracy of GNSS can be severely challenged in urban canyons due to the high-rising buildings, leading to numerous Non-line-of-sight (NLOS) receptions and multipath effects. Moreover, the excessive dynamic objects can also distort the performance of LiDAR, and camera. The UrbanNav dataset wishes to provide a challenging data source to the community to further accelerate the study of accurate and robust positioning in challenging urban canyons. The dataset includes sensor measurements from GNSS receiver, LiDAR, camera and IMU, together with accurate ground truth from SPAN-CPT system. Different from the existing dataset, such as Waymo, KITTI, UrbanNav provide raw GNSS RINEX data. In this case, users can improve the performance of GNSS positioning via raw data. In short, the UrbanNav dataset pose a special focus on improving GNSS positioning in urban canyons, but also provide sensor measurements from LiDAR, camera and IMU. If you got any problems when using the dataset and cannot find a satisfactory solution in the issue list, please open a new issue and we will reply ASAP.
Key words: Positioning, Localization, GNSS Positioning, Urban Canyons, GNSS Raw Data,Dynamic Objects, GNSS/INS/LiDAR/Camera, Ground Truth
Updated Version of the dataset
- An updated UrbanNavDataset is available for testing and evaluation.
If you use UrbanNav for your academic research, please consider citing our paper
- Hsu, Li-Ta, Nobuaki Kubo, Weisong Wen, Wu Chen, Zhizhao Liu, Taro Suzuki, and Junichi Meguro. "UrbanNav: An open-sourced multisensory dataset for benchmarking positioning algorithms designed for urban areas." In Proceedings of the 34th International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS+ 2021), pp. 226-256. 2021.
Important Notes:
- About access to GNSS RINEX file: The GNSS measurements is provided as GNSS RINEX data. We will recently open-source a package, the GraphGNSSLib, which provide easy access to the GNSS RINEX file and publish the data as customized ROS message. Meanwhile, we GraphGNSSLib also provide the capabilities of GNSS positioning and real-time kinematic (RTK) using factor graph optimization (FGO). If you wish to use the GraphGNSSLib, keep an eye on the update of this repo.
- Dataset contribution: Researches who wish to contribute their dataset as part of the UrbanNav dataset, please feel free to contact me via email 17902061r@connect.polyu.hk. We wish the UrbanNav can be a platform for navigation solution development, validation and sharing.
- Algorithm validation and contribution: Researches are welcomed to share their navigation solution results, source code to the UrbanNav dataset after a code review process, e,g, code for GNSS/INS integration or LiDAR SLAM, etc.
-
Benchmarking different positioning algorithms using the open-sourced dataset.
-
Raising the awareness of the urgent navigation requirement in highly-urbanized areas especially in Asian-Pacific regions.
Contact Authors (corresponding to issues and maintenance of the currently available dataset): Weisong Wen, Feng Huang,Li-ta Hsu from the Intelligent Positioning and Navigation Laboratory, The Hong Kong Polytechnique University
Related Papers:
- Wen, Weisong, Xiwei Bai, Li-Ta Hsu, and Tim Pfeifer. "GNSS/LiDAR Integration Aided by Self-Adaptive Gaussian Mixture Models in Urban Scenarios: An Approach Robust to Non-Gaussian Noise." In 2020 IEEE/ION Position, Location and Navigation Symposium (PLANS), pp. 647-654. IEEE, 2020.
if you use GraphGNSSLib for your academic research, please cite our related papers
Work related to urbanNav Dataset :
- Li, Tao, Ling Pei, Yan Xiang, Qi Wu, Songpengcheng Xia, Lihao Tao, and Wenxian Yu. "P3-LOAM: PPP/LiDAR Loosely Coupled SLAM with Accurate Covariance Estimation and Robust RAIM in Urban Canyon Environment." IEEE Sensors Journal (2020). paper
- Chen, Chao, and Guobin Chang. "PPPLib: An open-source software for precise point positioning using GPS, BeiDou, Galileo, GLONASS, and QZSS with multi-frequency observations." GPS Solutions 25, no. 1 (2020): 1-7. PPPLib Code, paper
The platform for data collection in Hong Kong is a Honda Fit. The platform is equipped with the following sensors:
- 3D LiDAR sensor (HDL 32E Velodyne): (360 HFOV, +10~-30 VFOV, 80m range, 10Hz)
- IMU (Xsens Mti 10, 100 Hz, AHRS)
- GNSS receiver: u-blox M8T or u-blox F9P (to be updated)
- camera:(1920X1200,79.4°X96.8°, 10Hz)
- SPAN-CPT:(RTK GNSS/INS, RMSE: 5cm, 1Hz)
Brief: Dataset UrbanNav-HK-Data20190428 is collected in a typical urban canyon of Hong Kong near TST which involves high-rising buildings, numerous dynamic objects. The coordinates transformation between multiple sensors, and intrinsic measurements of camera can be found via Extrinsic Parameters, IMU Nosie and Intrinsic Parameters of Camera.
Some key features are as follows:
Date of Collection | Total Size | Path length | Sensors |
---|---|---|---|
2019/04/28 | 42.9 GB | 2.01 Km | GNSS/LiDAR/Camera/IMU/SPAN-CPT |
- Download by Dropbox Link: Data INFO
- UrbanNav-HK-Data20190428 (ROS)
- ROSBAG file which includes:
- GNSS positioning (solution directly from GNSS receiver):
/ublox_node/fix
- 3D LiDAR point clouds:
/velodyne_points
- Camera:
/camera/image_color
- IMU:
/imu/data
- SPAN-CPT:
/novatel_data/inspvax
- GNSS positioning (solution directly from GNSS receiver):
- ROSBAG file which includes:
- GNSS (RINEX)
- GNSS RINEX files, to use it, we suggest to use the RTKLIB
- IMU/SPAN-CPT (CSV)
- IMU and SPAN-CPT data for non-ROS users.
- UrbanNav-HK-Data20190428 (ROS)
For mainland china users, please download the dataset using the Baidu Clouds Links
- Download by Baidu Cloud Link: Data INFO, (qm3l)
- UrbanNav-HK-Data20190428 (ROS) (nff4)
- ROSBAG file whihc includes:
- GNSS positioning (solution directly from GNSS receiver):
/ublox_node/fix
- 3D LiDAR point clouds:
/velodyne_points
- Camera:
/camera/image_color
- IMU:
/imu/data
- SPAN-CPT:
/novatel_data/inspvax
- GNSS positioning (solution directly from GNSS receiver):
- ROSBAG file whihc includes:
- GNSS (RINEX) (gojb)
- GNSS RINEX files, to use it, we suggest to use the RTKLIB
- IMU/SPAN-CPT (CSV) (k3dz)
- IMU and SPAN-CPT data for non-ROS users.
- UrbanNav-HK-Data20190428 (ROS) (nff4)
Brief: Dataset UrbanNav-HK-Data2020314 is collected in a low-urbanization area in Kowloon which suitable for algorithmic verification and comparison. The coordinates transformation between multiple sensors, and intrinsic measurements of camera can be found via Extrinsic Parameters, IMU Nosie and Intrinsic Parameters of Camera.
Some key features are as follows:
Date of Collection | Total Size | Path length | Sensors |
---|---|---|---|
2020/03/14 | 27.0 GB | 1.21 Km | LiDAR/Camera/IMU/SPAN-CPT |
- Download by Dropbox Link:
- UrbanNav-HK-Data20200314 (ROS)
- ROSBAG file which includes:
- 3D LiDAR point clouds:
/velodyne_points
- Camera:
/camera/image_color
- IMU:
/imu/data
- SPAN-CPT:
/novatel_data/inspvax
- 3D LiDAR point clouds:
- ROSBAG file which includes:
- GNSS (RINEX)
- GNSS RINEX files, to use it, we suggest to use the RTKLIB
- UrbanNav-HK-Data20200314 (ROS)
For mainland china users, please download the dataset using the Baidu Clouds Links
- Download by Baidu Cloud Link:
- UrbanNav-HK-Data20200314 (ROS) (n71w)
- ROSBAG file whihc includes:
- 3D LiDAR point clouds:
/velodyne_points
- Camera:
/camera/image_color
- IMU:
/imu/data
- SPAN-CPT:
/novatel_data/inspvax
- 3D LiDAR point clouds:
- ROSBAG file whihc includes:
- GNSS (z8vw) (RINEX)
- GNSS RINEX files, to use it, we suggest to use the RTKLIB
- UrbanNav-HK-Data20200314 (ROS) (n71w)
The platform for data collection in Tokyo is a Toyota Rush. The platform is equipped with the following sensors:
- 3D LiDAR sensor (VLP-32C Velodyne): (360 HFOV, +15~-25 VFOV, 200m range, 10Hz)
- GNSS receiver: u-blox F9P (5 Hz) and Trimble NetR9 (10 Hz)
- IMU (Tamagawa-seiki TAG264, 50 Hz)
- Ground truth Applanix POS LV620:(RTK GNSS/INS, RMSE: 5cm, 10Hz)
Important Notes: the LiDAR calibration file for the LiDAR sensor, extrinsic parameters between sensors are not available now. If you wish to study the GNSS/LiDAR/IMU integration, we suggest using the dataset above collected in Hong Kong. However, the GNSS dataset from Tokyo is challenging which is collected in challenging urban canyons!
Date of Collection | Total Size | Path length | Sensors |
---|---|---|---|
2018/12/19 | 4.14 GB | >10 Km | GNSS/LiDAR/IMU/Ground Truth |
-
Download by Dropbox Link: For mainland china users, please download the dataset using the Baidu Clouds Links. Baidu Clouds Links (7xpo)
-
The dataset contains data from two runs,
/Odaiba
and/Shinjuku
. -
The following files are included in each dataset.
rover_ublox.obs
androver_trimble.obs
: Rover GNSS RINEX files (5 Hz / 10 Hz)imu.csv
: CSV file which includes GPS time, Angular velocity, and acceleration, (50 Hz)lidar.bag
: ROSBAG file which includes LiDAR data/velodyne_packets
base_trimble.obs
andbase.nav
: GNSS RINEX files of base station (1 Hz)reference.csv
: Ground truth from Applanix POS LV620 (10 Hz)
-
The travel trajectory of
/Odaiba
- The travel trajectory of
/Shinjuku
We acknowledge the help from Guohao Zhang, Yin-chiu Kan Weichang Xu and Song Yang for data collection.
For any technical issues, please contact Weisong Wen via email 17902061r@connect.polyu.hk. For commercial inquiries, please contact Li-ta Hsu via email lt.hsu@polyu.edu.hk.
-
Wen, Weisong, Guohao Zhang, and Li-Ta Hsu. "Exclusion of GNSS NLOS receptions caused by dynamic objects in heavy traffic urban scenarios using real-time 3D point cloud: An approach without 3D maps." Position, Location and Navigation Symposium (PLANS), 2018 IEEE/ION. IEEE, 2018.
-
Wen, W.; Hsu, L.-T.*; Zhang, G. (2018) Performance analysis of NDT-based graph slam for autonomous vehicle in diverse typical driving scenarios of Hong Kong. Sensors 18, 3928.
-
Wen, W., Zhang, G., Hsu, Li-Ta (Presenter), Correcting GNSS NLOS by 3D LiDAR and Building Height, ION GNSS+, 2018, Miami, Florida, USA.
-
Zhang, G., Wen, W., Hsu, Li-Ta, Collaborative GNSS Positioning with the Aids of 3D City Models, ION GNSS+, 2018, Miami, Florida, USA. (Best Student Paper Award)
-
Zhang, G., Wen, W., Hsu, Li-Ta, A Novel GNSS based V2V Cooperative Localization to Exclude Multipath Effect using Consistency Checks, IEEE PLANS, 2018, Monterey, California, USA. Copyright (c) 2018 Weisong WEN
-
Wen Weisong., Tim Pfeifer., Xiwei Bai., Hsu, L.T.* Comparison of Extended Kalman Filter and Factor Graph Optimization for GNSS/INS Integrated Navigation System, The Journal of Navigation, 2020, (SCI. 2019 IF. 3.019, Ranking 10.7%) [Submitted]