Finding specific moments in lifelog collections is often difficult, as users must navigate large streams of temporally ordered images while refining queries on the fly. In this paper, we present a redesigned version of VISIONE, an interactive retrieval system tailored to the Lifelog Search Challenge (LSC). Building on our previous participation, the system has been restructured to better support time-constrained search scenarios and iterative query refinement. The new version introduces a modular architecture that integrates multiple retrieval modalities, including multimodal embeddings and metadata-based filtering, within a unified framework. On the interaction side, the interface has been redesigned to simplify query formulation through sequence-based temporal queries, while still allowing expert users to control retrieval strategies and employed feature representations. Additional components, such as relevance feedback and LLM-assisted query processing, further support both exploratory and task-driven search. Taken together, these design choices aim to make the system more effective in practice, enabling users to quickly narrow down large lifelog collections and converge toward relevant moments under realistic LSC conditions.

VISIONE: Redesigning an interactive retrieval system for lifelog search

Amato Giuseppe;Bolettieri Paolo;Carrara Fabio;Falchi Fabrizio;Gennaro Claudio;Messina Nicola;Vadicamo Lucia
;
Vairo Claudio
2026

Abstract

Finding specific moments in lifelog collections is often difficult, as users must navigate large streams of temporally ordered images while refining queries on the fly. In this paper, we present a redesigned version of VISIONE, an interactive retrieval system tailored to the Lifelog Search Challenge (LSC). Building on our previous participation, the system has been restructured to better support time-constrained search scenarios and iterative query refinement. The new version introduces a modular architecture that integrates multiple retrieval modalities, including multimodal embeddings and metadata-based filtering, within a unified framework. On the interaction side, the interface has been redesigned to simplify query formulation through sequence-based temporal queries, while still allowing expert users to control retrieval strategies and employed feature representations. Additional components, such as relevance feedback and LLM-assisted query processing, further support both exploratory and task-driven search. Taken together, these design choices aim to make the system more effective in practice, enabling users to quickly narrow down large lifelog collections and converge toward relevant moments under realistic LSC conditions.
2026
Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI
9798400726972
Multimedia retrieval, Image search, Cross-modal search, Interactive system, Interactive retrieval, Lifelog retrieval, Egocentric images
File in questo prodotto:
File Dimensione Formato  
3810984.3819178_compressed.pdf

accesso aperto

Descrizione: VISIONE: Redesigning an Interactive Retrieval System for Lifelog Search
Tipologia: Versione Editoriale (PDF)
Licenza: Creative commons
Dimensione 1.23 MB
Formato Adobe PDF
1.23 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/594164
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact