Animal action recognition is crucial for assessing animal well-being in agriculture and environmental monitoring. Recent advancements in this field rely on computer vision technologies. However, many current applications are restricted to recognizing actions within a single animal species or a limited set of actions, resulting in highly specific models and lacking generality. When addressing a broader range of actions and species, transformer models are typically required, which demand significant computational and processing power, potentially limiting their practical use. In this work, we introduce a deep learning model based on selective state spaces designed to reduce the computational cost of MSQNet, the current state-of-the-art model for action recognition in the Animal Kingdom dataset. Our approach achieves superior results with fewer parameters and lower FLOPs, thereby enhancing efficiency without compromising performance. Code available on https://github.com/edofazza/mamba-msqnet.

Mamba-MSQNet: a fast and efficient model for animal action recognition

Fazzari E.;Falchi F.;
2024

Abstract

Animal action recognition is crucial for assessing animal well-being in agriculture and environmental monitoring. Recent advancements in this field rely on computer vision technologies. However, many current applications are restricted to recognizing actions within a single animal species or a limited set of actions, resulting in highly specific models and lacking generality. When addressing a broader range of actions and species, transformer models are typically required, which demand significant computational and processing power, potentially limiting their practical use. In this work, we introduce a deep learning model based on selective state spaces designed to reduce the computational cost of MSQNet, the current state-of-the-art model for action recognition in the Animal Kingdom dataset. Our approach achieves superior results with fewer parameters and lower FLOPs, thereby enhancing efficiency without compromising performance. Code available on https://github.com/edofazza/mamba-msqnet.
2024
Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI
979-8-3503-5544-4
Animal action recognition
Computer vision
Deep learning
Mamba
MSqnet
Selective state spaces
File in questo prodotto:
File Dimensione Formato  
Mamba-MSQNet_A_Fast_and_Efficient_Model_for_Animal_Action_Recognition.pdf

solo utenti autorizzati

Descrizione: Mamba-MSQNet: A Fast and Efficient Model for Animal Action Recognition
Tipologia: Versione Editoriale (PDF)
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 958.41 kB
Formato Adobe PDF
958.41 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/552101
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 0
social impact