Real-time control of cooperative robots, or cobots, in industrial environments is a mandatory task to reduce the risk for workers by improving their safety. The task of cobot control always requires input data about the surroundings to enable planning procedures and proper reactions to unpredictable events, such as human actions. In this case, the exact position of the humans can be easily inferred from RGB-D cameras, whose output can be processed by body tracking modules to produce exact pose estimations in real-time. This paper experimentally explores the performance of the affordable Microsoft Azure Kinect RGB-D camera and its body-tracking library. A parametric analysis of the uncertainty of the estimation of the skeleton joints is performed by changing the ambient light conditions, the presence of occlusions, the infrared camera resolution, and the human-camera distance. The output of this investigation proves the need for uncertainty management in the control of cobots working with humans.

Performance Analysis of Body Tracking with the Microsoft Azure Kinect

Laura Romeo;Roberto Marani;Matteo Malosio;
2021

Abstract

Real-time control of cooperative robots, or cobots, in industrial environments is a mandatory task to reduce the risk for workers by improving their safety. The task of cobot control always requires input data about the surroundings to enable planning procedures and proper reactions to unpredictable events, such as human actions. In this case, the exact position of the humans can be easily inferred from RGB-D cameras, whose output can be processed by body tracking modules to produce exact pose estimations in real-time. This paper experimentally explores the performance of the affordable Microsoft Azure Kinect RGB-D camera and its body-tracking library. A parametric analysis of the uncertainty of the estimation of the skeleton joints is performed by changing the ambient light conditions, the presence of occlusions, the infrared camera resolution, and the human-camera distance. The output of this investigation proves the need for uncertainty management in the control of cobots working with humans.
2021
Istituto di Sistemi e Tecnologie Industriali Intelligenti per il Manifatturiero Avanzato - STIIMA (ex ITIA)
calibration
body tracking
human-robot interaction
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/395258
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact