Angle-Agnostic Radio Frequency Sensing Integrated into 5G-NR

The fusion of Radio Frequency (RF) sensing with cellular communication networks presents a revolutionary paradigm, enabling networks to seamlessly integrate communication and perception capabilities. Leveraging electromagnetic radiation, this technology facilitates the detection and interpretation of human movements, activities, and environmental changes. This paper proposes a novel implementation of RF sensing within the allocated resources for New Radio (NR) sidelink direct Device-To-Device (D2D) communication, showcasing the synergy between RF sensing and Machine Learning (ML) techniques. The paper addresses the inherent challenge of angle dependency in the sidelink-enabled sensing scheme, and introduces innovative solutions to achieve angle-agnostic environmental perception. The proposed approach incorporates a graph-based encoding of movement and gesture sequences, capturing spatio-temporal relations, and integrates orientation tracking to enhance human gesture recognition. The proposed model surpasses state-of-the-art algorithms, demonstrating a remarkable 100% accuracy in RF sensing when all the angles are available. Although the performance of our proposed method does decline with fewer available angles, it demonstrates exceptional resilience to missing data. Specifically, our model significantly outperforms existing models by approximately 70% in scenarios where 7 out of 8 angles are unavailable. To further advance sensing capabilities in RF sensing systems, a comprehensive dataset comprising 15 subjects performing 21 gestures, recorded from 8 different angles, is openly shared. This contribution aims to enhance the performance and reliability of RF sensing systems by providing a robust and efficient ML-driven solution for human gesture recognition within NR sidelink D2D communication networks, aligning with the latest advancements in machine learning for RF sensing applications.