Nowadays, the increasing use of virtual conversational assistants raises important societal and ethical challenges. In fact, these systems can reflect and amplify social biases present in the dataset they are trained on, potentially leading to unfair or discriminatory behaviour in their interactions. Biases can heavily influence decisions of agents used as advisors, in areas such as employment and education. As a result, they can limit opportunities and reinforce social inequalities. This contribution introduces a methodology for detecting social biases in AI dia-logues by taking into account the specific conversational context. As a case study, the emergence of social bias in an academic advisory practice is considered. The proposed methodology, along with the required resources and knowledge structures, relies on a social theory-based model that considers social context as a first-order construct in agent deliberation.

Ensuring Equitable Guidance: A Context-Based Approach to Bias Detection in AI Advisors

Augello A.
Primo
;
Sabatucci L.;Neroni P.;Casoria L.;Caggianese G.
Ultimo
2025

Abstract

Nowadays, the increasing use of virtual conversational assistants raises important societal and ethical challenges. In fact, these systems can reflect and amplify social biases present in the dataset they are trained on, potentially leading to unfair or discriminatory behaviour in their interactions. Biases can heavily influence decisions of agents used as advisors, in areas such as employment and education. As a result, they can limit opportunities and reinforce social inequalities. This contribution introduces a methodology for detecting social biases in AI dia-logues by taking into account the specific conversational context. As a case study, the emergence of social bias in an academic advisory practice is considered. The proposed methodology, along with the required resources and knowledge structures, relies on a social theory-based model that considers social context as a first-order construct in agent deliberation.
2025
Istituto di Calcolo e Reti ad Alte Prestazioni - ICAR
Conversational Agents
Large Language Models
Social Biases
Social Practices
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/582135
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ente

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact