LIBERTY ON PAROLE ? CHALLENGES IN INTERACTIVITY
Editors: Pietro Montani & Andrea Pinotti
Issue 2024, n. 2
Submission of full papers: July 15, 2024
Please note that, even if we invite full papers, authors are encouraged to reach out to the journal manager (Federica Cavaletti) and the editors to discuss their ideas before the final submission (this does not exclude that the manuscript will later be subject to regular peer review).
https://riviste.unimi.it/index.php/anicon/announcement/view/862
—
In his influential essay The Inevitable (2016), Kevin Kelly holds interactivity among the major forces that will shape the near future. He maintains that “in the coming 30 years, anything that is not intensely interactive will be considered broken.” Touch screens, smart objects and domotics, interactive television series, or adaptive AI-generated video-games, just give us a hint of how our daily experience is going to be transformed.
The concept of interactivity has been investigated in several different fields, in the belief that it is key to the way we inhabit the world in a broad sense. Just to make some examples, one may think about Gibson’s theory of affordances (1979) and its developments; the model of the Extended Mind (Clark & Chalmers 1998) and the Material Engagement Theory (Malafouris 2013); or Enactivism, according to which our interactions with our environments, or other organisms, constitute the grounding and the primary expression of cognition itself (Thompson 2007, Gallagher 2020).
The advent of electronic media, though, has made the concept of interactivity even more pervasive. Indeed, since their first appearance, electronic media have been defined as “interactive”, in contrast to analogic apparatuses. The concept of interactivity aimed to describe both the ability of electronic interfaces to respond to a user’s input, and the way the user could interact with media and devices, choosing which path to follow, manipulating, or generating new content.
In the field of narratology, scholars have highlighted the advent of new forms of interactive storytelling (Murray 1997) and more recently of "Interactive Digital Narrative" (Koenitz, Ferri, Haahr, Sezen, & Sezen, 2015), concerning works by writers, artists and game designers. Compared to the traditional modes of interaction between the reader and the text – even when considered as non-passive (Eco 1979) – video games have been defined as "ergodic" texts, i.e. texts that require an effort from the reader/player (Aarseth 1997).
However, since any reception entails imaginative integrations and performative responses (Montani 2022), some scholars have claimed that interactivity is too broad a concept to account for the specificity of digital interfaces and should therefore be discarded (Manovich 2001).
Besides, the relation of reversibility and reciprocal feedback, brought about by electronic media and later by the implementation of artificial intelligence and linked to the concept of interface as well as of "interaction design", has pushed scholars in different fields to account for the agency of digital images (Hansen 2014), of technologies and media (Farocki 2004, Paglen 2014), and, more broadly, of non-human entities (Grusin 2015), as well as to reframe them in operational terms (Hoel 2018; Parikka 2023). A lot of attention has been paid to human-computer interaction, so as to develop user-friendly interfaces that give the illusion of no technical mediation (Weiser 1991). Today, digital technologies have become so ubiquitously present in our environment that they almost constitute the condition of possibility of our experience and interaction with the environment (Marras & Mecacci 2015).
Lastly, with the advent of Virtual and Augmented Reality and Artificial Intelligence, the notion of interactivity has conquered yet another field of application. In fact, several properties of VR-, AR- and AI-based environments may be explored by recurring to the notion of “interactivity”: in fact, such interactive environments offer extremely lifelike sensorimotor affordances; they involve the users in participatory creative processes, as happens in “virtual storytelling” (Dooley 2017, Bucher 2018); they include interactions with quasi-subjects known as “avatars” (Pinotti 2020), be they proxies of human subjects or AI-assisted characters; they pervasively spread in the domain of AI digital assistance (Pizzi, Scarpia & Pantano 2021), and in text-to-image and image-to-text models in AI-based programs like Midjourney, DALL-E, Stable Diffusion (Somaini 2023); they characterise procedurally generated open world universes (as is the case of video games such as No Man’s Sky).
VR, AR and AI not only afford new types of interactions with the environment, but they also provide the possibility of an intersubjective interactivity in a shared virtual world that sometimes results in the creation of new collective subjects, with shared/common perception, intentionality and needs (Liberati 2016). Importantly, both these spheres of interactions are regulated by strictly technical conditions, which inescapably shape and reverberate on the users’ experience. In this regard, the argument of interactivity cuts both ways, inasmuch as virtual interfaces also come to limit and constrain the user’s freedom (Chandrasekera, Fernando, & Puig 2019); or the degree and type of manipulability of a given environment and the objects it contains. This perspective revives in the context of new digital technologies a classic theme of philosophical reflection: that of free will. To what extent does interactivity emancipate the user and redefines the roles both of producer and consumer? To what extent is interactivity outlined as yet another articulation of that inevitable observance of rules (Crary 1990) that marks by definition every relationship of the observer with the media with which he interacts? To what extent does the gained freedom remain a form of freedom conditioned by structural constraints, a liberty on parole?
The issue particularly encourages proposals concerning:
· Theoretical interpretations of interactivity;
· Interdisciplinary and/or multi-methodological approaches to interactivity;
· Interactivity in VR, AR, XR, AI;
· Interactivity in visual arts, cinema, tv series, video-games, and other digital media;
· Interactive storytelling;
· Theories of active spectatorship;
· Analysis of emblematic cases and innovative works leveraging on interactivity;
· Interaction with avatars and props in digital and virtual environments.
—
Characters/word count
24.000-30.000 characters (spaces included), or 3.500-5.000 words
—
References :
Aarseth, E.J., Cybertext: Perspectives on Ergodic Literature (Baltimore – London: Johns Hopkins University Press, 1997).
Bucher, J.K., Storytelling for Virtual Reality: Methods and Principles of Crafting Immersive Narratives (London – New York: Routledge, 2018).
Cecchi, D. (ed.), “Intermediality and Interactivity”, Rivista di Estetica, no. 63 (2016).
Chandrasekera, T., K. Fernando, & L. Puig, “Effect of Degrees of Freedom on the Sense of Presence Generated by Virtual Reality (VR) Head-Mounted Display Systems: A Case Study on the Use of VR in Early Design Studios,” Journal of Educational Technology Systems 47, no. 4 (2019): 513-522.
Clark, A. & D. Chalmers, “The Extended Mind,” analysis 58, no.1 (1998): 7-19.
Crary, J., Techniques of the Observer: On Vision and Modernity in the Nineteenth Century, (Cambridge, Mass.: MIT Press, 1990).
Dooley, K., “Storytelling With Virtual Reality in 360-Degrees: a New Screen Grammar,” Studies in Australian Cinema 11, no.3 (2017): 161-71.
Eco, U., Lector in fabula, in The Role of the Reader: Explorations in the Semiotics of Texts (London: Hutchinson, 1981)
Farocki, H., “Phantom images,” Public, no. 29 (2004): 13-22.
Gallagher, S., Action and Interaction (Oxford: Oxford University Press, 2020).
Gibson, J., The Ecological Approach to Visual Perception (Boston: Houghton Mifflin Harcourt, HMH, 1979).
Grusin, R., The Nonhuman Turn (Minneapolis: Minnesota University Press, 2015).
Hansen, M.B.N., Feed Forward: On the Future of 21st Century Media (Chicago: University of Chicago Press, 2014).
Hoel, A.S., “Operative Images. Inroads to a New Paradigm of Media Theory,” in L. Feiersinger, K. Friedrich, & M. Queisner, eds., Image – Action – Space: Situating the Screen in Visual Practice (Berlin: De Gruyter, 2018).
Kelly, K., The Inevitable: Understanding the 12 Technological Forces That Will Shape Our Future (New York: Viking Press, 2016).
Koenitz, H., G. Ferri, M. Haahr, D. Sezen, & T.I Sezen, eds., Interactive Digital Narrative: History, Theory and Practice (London – New York: Routledge, 2015).
Liberati, N., “Augmented Reality and Ubiquitous Computing: The Hidden Potentialities of Augmented Reality,” AI & Society 31, no.1 (2016): 17-28.
Malafouris, L., How Things Shape the Mind (Cambridge (MA) – London: The MIT Press, 2013).
Manovich, L., The Language of New Media (Cambridge (MA) – London: The MIT Press, 2001).
Manovich, L., Cultural Analytics (Cambridge, MA : The MIT Press, 2020).
Montani, P., Technological Destinies of the Imagination (Milano – Udine: Mimesis International, 2022).
Murray, J.H., Hamlet on the Holodeck: The Future of Narrative in Cyberspace (Cambridge (MA) – London: The MIT Press, 1997).
Paglen, T., 2014. “Operational Images,” E-Flux 59, 2014.
Parikka, J., Operational Images : from the Visual to the Invisual (Minneapolis ; London : University of Minnesota Press, 2023).
Pinotti, A., “18. Avatars: Shifting Identities in a Genealogical Perspective,” in H. Aldouby, ed., Shifting Interfaces. An Anthology of Presence, Empathy, and Agency in 21st Century Media Arts (Leuven: Leuven University Press, 2020): 31-45.
Pizzi, G., Scarpia, D., & Pantano, E., “Artificial Intelligence and the New Forms of Interaction: Who Has the Control When Interacting With a Chatbot?”, Journal of Business Research, no. 129 (2021): 878-90.
Ryan, M.-L., Narrative as Virtual Reality : Immersion and Interactivity in Literature and Electronic Media (Baltimore - London: Johns Hopkins University Press, 2001).
Schroeder, R., ed., The Social Life of Avatars. Presence and Interaction in Shared Virtual Environments (London: Springer, 2002).
Slater, M. & M. Usoh, “Body Centered Interaction in Immersive Virtual Environments,” in N.M. Thalmann, & D. Thalmann, eds., Artificial Life and Virtual Reality (New York: Wiley, 1994): 125-48.
Somaini, A., “Algorithmic Images. Artificial Intelligence and Visual Culture”, Grey Room, no. 93 (2023): 74-115.
Thompson, E., Mind in Life: Biology, Phenomenology, and the Sciences of Mind (Cambridge (MA) – London: Harvard University Press, 2007).
Weiser, M., “The Computer for the 21st Century,” Scientific American 265, no.3 (1991): 94-104.