As our relationship with technology becomes increasingly intimate, we become increasingly vulnerable to its effects. Simultaneously, a growing moral distance separates those who develop and deploy the technology from those affected by it. The development of intimate technologies like recommender systems, brain-machine interfaces, and therapy chatbots often involve the diffuse contributions of hundreds of people. This vast scale not only renders these individuals systemically invulnerable to the users’ indignation—due their lack of proximity—but also prevents them from standing in the right relation to the harms their technology may proliferate, given their diffuse nature of their contributions. Consequently, the users’ vulnerability is neither mutual nor reciprocal; it stems from a dynamic of systemic invulnerability on the part of the developers. This asymmetric relationship of vulnerability creates what Vallor and Vierkant (2024) term a 'vulnerability gap' between the creators of these technologies and their users. In this paper, I apply the concept of vulnerability gaps to the intimate technological revolution. I identify that as intimate technologies mature, the sociotechnical system that gives rise to them simultaneously breaks down the moral practices that enable more redress between their developers and users.
First, I develop an account of how intimate and often invasive technology makes us materially and emotionally vulnerable to them, arguing that our increasing dependence on these systems creates unprecedented forms of exposure to harm.
Second, drawing on Weber (1978) and Arendt's (2007; 2016; 2022) analysis of bureaucratic rationalisation, as well as instrumentalist accounts of moral responsibility from McGeer (2015) and Vargas (2013), I demonstrate how technological intimacy emerges through processes that reducing aspects of human life to technical-logistical problems. These processes dehumanise users and distance developers from moral redress through institutional structures, responsibility diffusion, and recourse to economic incentives.
Third, I show how this combination—increasing technological intimacy and decreasing moral feedback—creates a particularly dangerous moment in technological development and in the sustainability of our moral ecology. This erosion of traditional moral practices occurs precisely as these technologies gain unprecedented access to and influence over lives.
I conclude by examining how we might preserve and extend spaces for moral engagement within technological development. Drawing on analyses of bureaucratic rationalisation, I propose specific practices and institutional arrangements that could enable developers to encounter the human implications of their work directly, rather than solely through technical metrics. This includes maintaining existing channels of moral feedback where they function well, while creating new opportunities for affected users to meaningfully shape development processes. These proposals aim to balance the technical rationality necessary for development with spaces where genuine moral engagement and judgment can occur, allowing our moral practices to evolve alongside our technological capabilities.
References
Arendt, H. (2007). The Origins of Totalitarianism. In: Lawrence, B. B. and Karim, A. (Eds). On Violence: A Reader. Duke University Press. pp.417–443. [Online]. Available at: doi:10.1515/9780822390169-056 [Accessed 14 January 2025].
Arendt, H. (2016). On Violence. In: Blaug, R. and Schwarzmantel, J. (Eds). Democracy: A Reader. Columbia University Press. pp.566–574. [Online]. Available at: doi:10.7312/blau17412-117 [Accessed 14 January 2025].
Arendt, H. (2022). Eichmann in Jerusalem: a report on the banality of evil, Modern classics. London: Penguin Books.
McGeer, V. (2015). Building a better theory of responsibility. Philosophical Studies, 172 (10), pp.2635–2649. [Online]. Available at: doi:10.1007/s11098-015-0478-1.
Vallor, S. and Vierkant, T. (2024). Find the Gap: AI, Responsible Agency and Vulnerability. Minds and Machines, 34 (3), p.20. [Online]. Available at: doi:10.1007/s11023-024-09674-0.
Vargas, M. (2013). Building Better Beings: A Theory of Moral Responsibility. OUP Oxford.
Weber, M. (1978). Economy and Society: An Outline of Interpretive Sociology. Univ of California Press.