Evaluating AAL Solutions Through Competitive Benchmarking: The Localization Competition

Evaluation of Ambient Assisted Living (AAL) systems is particularly challenging due to the complexity of such systems and to the variety of solutions adopted and services offered. This problem is related to the evaluation of pervasive and ubiquitous systems that has been the focus of many researchers in the recent years and that still awaits for solutions. On the other hand, analyzing and comparing AAL solutions is paramount for the assessment of the research results in this area. EvAAL (Evaluating AAL Systems Through Competitive Benchmarking) is a recently established international competition that aims to address this problem in order to let benchmarking and comparison methodologies of AAL systems emerge from experience. This work describes the first EvAAL competition which was devoted to localization and tracking; proposed evaluation criteria, benchmarks, and achieved results are reported.