Human autonomy with AI in the loop

In the wake of recent advancements in the field of AI, this paper investigates the impact of recommender systems and generative models on human decisional and creative autonomy. For this purpose, we adopt Dennett’s conception of autonomy as self-control. We show that recommender systems can play a double role in relation to decisional autonomy: as information filter, they can augment self-control in decision-making, but also act as mechanisms of remote control that clamp degrees of freedom. As for generative models in AI, we show that they can be seen as a powerful system of selection and suggestion (similar to standard recommender systems) but also as an instrument for information production. We suggest that the latter perspective opens new possibilities in terms of creative autonomy. Additionally, for both systems we propose a distinction between “extrinsic” and “intrinsic” mechanisms and effects. Through Dennett’s theory of self-control, this paper offers new insights into the relation between AI and human autonomy by framing it in terms of remote or self-control and by addressing the impact of generative models on creative autonomy.