Abstract
With robots leaving factories and entering less controlled domains, possibly sharing the space with humans, safety is paramount and multimodal awareness of the body surface and the surrounding environment is fundamental. Taking inspiration from peripersonal space representations in humans, we present a framework on a humanoid robot that dynamically maintains such a protective safety zone, composed of the following main components: (i) a human 2D keypoints estimation pipeline employing a deep learning based algorithm, extended here into 3D using disparity; (ii) a distributed peripersonal space representation around the robots body parts; (iii) a reaching controller that incorporates all obstacles entering the robots safety zone on the fly into the task. Pilot experiments demonstrate that an effective safety margin between the robots and the humans body parts is kept. The proposed solution is flexible and versatile since the safety zone around individual robot and human body parts can be selectively modulated - -here we demonstrate stronger avoidance of the human head compared to rest of the body. Our system works in real time and is self-contained, with no external sensory equipment and use of onboard cameras only.
DOI
10.1145/3171221.3171245
Publication Date
2018-02-26
Event
HRI '18: ACM/IEEE International Conference on Human-Robot Interaction
Publication Title
Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction
Publisher
ACM
Embargo Period
2024-11-22
Recommended Citation
Nguyen, D., Hoffmann, M., Roncone, A., Pattacini, U., & Metta, G. (2018) 'Compact Real-time Avoidance on a Humanoid Robot for Human-robot Interaction', Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, . ACM: Available at: https://doi.org/10.1145/3171221.3171245