Sensorische Praktiken im Smart Home. Erkenntnisse und methodische Reflexion einer interdisziplinären Pilotstudie

The working paper presents, as a proof of concept, initial findings from an interdisciplinary pilot study that employs methods from sociological and linguistic media research to investigate how everyday household practices are represented and transformed through smart, sensor-based media technologies, which can be observed as multimodal interactions. Within the framework of the project “B06 – Un-/Desired Observation in Interaction: Smart Environments, Language, Body, and Senses in Private Households” in the Collaborative Research Center “Media of Cooperation”, the domestication of smart technologies is examined as a case of the cooperative production of media and data—both with and without consent (Star and Griesemer 1989).The focus of the presented pilot study is on human-machine cooperation, in which the more or less noticeable capture of behavioral and environmental data by sensors contributes to the semi-automated shaping of household ecologies and processes. We reconstruct and analyze forms of interaction and communication with interfaces of these modern technologies, as well as the sensory orientations and bodily practices of users. Furthermore, we examine the spatial and material arrangements that are essential for the social and communicative organization, as well as the purposiveness and goal-directedness of socio-technical actions involving these devices. We present exploratory media-sociological and media-linguistic analyses of a living environment equipped with smart devices, exemplified by two specific devices: an Amazon Echo Show (10th gen.), a ‘rotating’ smart speaker with a voice user interface, camera, display, video/touch screen, and camera-based motion detection, and a smart, internet-connected air fryer. The study demonstrates that users are embedded in human-machine interaction through their human sensorium—both socio-cognitively and physically—and are challenged in situ to make various decisions.