ROS is a set of well-engineered software libraries for building robotics applications. It includes a wide variety of packages, from low level drivers to efficient implementations of state of the art algorithms. As we strive to build intelligent agents and transfer them to real-world (on a real robot), we need to take advantage of ROS packages to complete the robot application pipeline.
As a starter, we provide an example of integrating Gibson with ROS. This is a ros package integrates Gibson Env with ros navigation stack. It follows the same node topology and topics as turtlebot_navigation
package. As shown below, so after a policy is trained in Gibson, it requires minimal changes to deploy onto a turtlebot.
Here is all the steps you need to perform to install gibson and ros. Note that here you will need to install from source and use python2.7. If you did it differntly when installing Gibson, you will need to do it again. python3 is known to not being able to work with ros.
- Install ROS: in this package, we use navigation stack from ros kinetic. Please follow the instructions.
- Install gibson from source following installation guide in python2.7. However, as ros only supports
python2.7
at the moment, you need to create python2.7 virtual environment instead of python3.5. - If you use annaconda for setting up python environment, some tweaks of
PATH
andPYTHONPATH
variable are required to avoid conflict. In particular:- For
PATH
: conda related needs to be removed fromPATH
echo $PATH | grep -oP "[^:;]+" | grep conda ## Remove these paths from $PATH
- For
PYTHONPATH
:/usr/lib/python2.7/dist-packages/
,/opt/ros/kinetic/lib/python2.7/dist-packages
(ros python libraries),<anaconda installation root>/anaconda2/envs/py27/lib/python2.7/site-packages
(gibson dependencies) and<gibson root>
need to be inPYTHONPATH
.
- For
- Copy (or soft link) gibson-ros folder to your
catkin_ws/src
and run catkin_make to index gibson-ros package.
ln -s $PWD/examples/ros/gibson-ros/ ~/catkin_ws/src/
cd ~/catkin_ws && catkin_make && cd -
- Install
gibson-ros
dependencies:
rosdep install gibson-ros
which python #should give /usr/bin/python
python -c 'import gibson, rospy, rospkg' #you should be able to do those without errors.
In order to run gibson+ros examples, you will need to perform the following steps:
- Prepare ROS environment
source /opt/ros/kinetic/setup.bash
source <catkin-workspace-root>/catkin_ws/devel/setup.bash
- Repeat step 3 from Preparation, sanitize
PATH
andPYTHONPATH
- Here are some of the examples that you can run, including gmapping, hector mapping and navigation.
roslaunch gibson-ros turtlebot_gmapping.launch #Run gmapping
roslaunch gibson-ros turtlebot_hector_mapping.launch #Run hector mapping
roslaunch gibson-ros turtlebot_navigation.launch #Run the navigation stack, we have provided the map
The following screenshot is captured when running the gmapping example.
Here are all the topics that turtlebot_rgbd.py
and simulation_clock.py
publishes and subscribes.
simulation_clock.py
Publishes:
Topic name | Type | Usage |
---|---|---|
/gibson_ros/sim_clock |
std_msgs/Int64 |
Controls the simulation clock, everytime turtlebot_rgbd.py receives this message it will tick the simulation. |
Subscribes: None
turtlebot_rgbd.py
Publishes:
Topic name | Type | Usage |
---|---|---|
/gibson_ros/camera/depth/camera_info |
sensor_msgs/CameraInfo |
Camera parameters used in Gibson, same for depth and rgb |
/gibson_ros/camera/rgb/image |
sensor_msgs/Image |
RGB image captured in Gibson |
/gibson_ros/camera/rgb/depth |
sensor_msgs/Image |
depth image captured in Gibson, in meters, with dtype being float32 |
/gibson_ros/camera/rgb/depth_raw |
sensor_msgs/Image |
depth image captured in Gibson, mimic raw depth data captured with OpenNI cameras, with dtype being uint16, see more here |
/odom |
nav_msgs/Odometry |
odometry from odom frame to base_footprint , generated with groudtruth pose in Gibson |
Subscribes:
Topic name | Type | Usage |
---|---|---|
/gibson_ros/sim_clock |
std_msgs/Int64 |
Controls the simulation clock, everytime turtlebot_rgbd.py receives this message it will tick the simulation. |
/mobile_base/commands/velocity |
geometry_msgs/Twist |
Velocity command for turtlebot, msg.linear.x is the forward velocity, msg.angular.z is the angular velocity |