Mobile Robotics & UAVs

Team NimbRo @ MBZIRC

I participated in two MBZIRC editions with Team NimbRo, completing various challenges that integrated UAVs, UGVs, and cross-platform collaboration.

MBZIRC 2017 In the 2017 edition, the UAV’s task was to land on a moving truck and autonomously collect moving objects from the ground. Meanwhile, the UGV had to locate a black box within the arena, approach it, and identify the side featuring hanging wrenches. From several available options, the UGV needed to select the correctly sized wrench to identify a valve, estimate its pose, and rotate it.

I developed a deep learning-based approach to locate specific wrenches and implemented a module for valve pose estimation using a short-range pmd CamBoard pico flexx depth camera; these contributions are detailed in the following article:” (Schwarz et al., 2019)

MBZIRC 2020 The 2020 edition focused on autonomous firefighting, where I contributed to both UAV and UGV development. I designed an object detection module for the UAV, optimizing it for energy-efficient execution on an on-board Google Edge TPU. For the UGV, I implemented object detection and 3D model registration using laser point clouds. These contributions are detailed in the following papers: (Lenz et al., 2020) and (Lenz et al., 2022)

UAV with on-board Edge TPU.
Object detection and registration using laser point clouds.

References

2022

  1. ugv-2020.png
    Autonomous Wall-building and Firefighting: Team NimbRo’s UGV Solution for MBZIRC 2020
    Christian Lenz, Jan Quenzel, Arul Selvam Periyasamy, and 7 more authors
    Field Robotics, vol. 2, pp. 55-74, 2022

2020

  1. uav-2020.png
    Autonomous wall building with a UGV-UAV team at MBZIRC 2020
    Christian Lenz, Max Schwarz, Andre Rochow, and 4 more authors
    In IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), 2020

2019

  1. wrench.png
    Team NimbRo at MBZIRC 2017: Autonomous valve stem turning using a wrench
    Max Schwarz, David Droeschel, Christian Lenz, and 7 more authors
    Journal of Field Robotics (JFR), 2019