This study aims to analyze communication with the deceased's technological artifacts presented by virtual reality media, based on the medium theory and cybernetics, to examine the patterns of time reconstruction experiences and to consider human commu...
This study aims to analyze communication with the deceased's technological artifacts presented by virtual reality media, based on the medium theory and cybernetics, to examine the patterns of time reconstruction experiences and to consider human communications from the perspective of temporality. Communication research has primarily focused on and handled virtual reality media phenomena in terms of space. Additionally, there has been a tendency to otherize the technological artifacts of the deceased as tools. This approach overlooks the importance of time — a core foundation of communication — and underestimates the influence of the technological artifacts of the deceased on human time experiences as communication subjects. Therefore, in an era where the boundaries between humans and non-humans have become blurred, research on the phenomenon of virtual reality media embodying the deceased's technological artifacts and mediating communication with humans, needs to observe the patterns of humans' time reconstruction experiences and appropriately evaluate the role of communication participants to technological artifacts.
To this end, this study adopted the medium theory as its first theoretical framework. As the medium theory is applied for analyzing media communication with a focus on physical and technical attributes of media, it contributes to preventing discussions of new media phenomena presented by virtual reality media from becoming speculative, and it is useful for analyzing the specific effects of media attributes on time experiences. Cybernetics, which emphasizes the connection between humans and “machines” in communication, helps us systematically understand the “media-environment” that amplifies time experience effects through interactions between technological artifacts of the deceased and humans.
Before the analysis from the perspective of the medium theory, this study attempted to examine philosophical reflections on images and layers of time in order to identify the basis for the phantasmagoric property of images and the process of time reconstruction. Furthermore, by incorporating “remediation” logic into the medium theory, it has figured out the principle of how layers of time are distinctively inscribed in media by following the historical genealogy of optical media. As virtual reality media, a keyword in this study, remediates optical media, it can influence time experiences by accepting and transforming existing optical media, inscribing additional layers of time, and renewing the arrangement between layers.
The second theoretical framework of this study can be found in cybernetics. At present, where the communication environment is integrated into “computational media”, the new media environment, with the virtual reality media introduced, can become the foundation that can amplify the effects of time experiences induced by media properties. In particular, when non-humans engage in communication, the breadth and intensity of changes in time experiences can exceed the range experienced in communication between humans. Cybernetics is in line with the researcher's perspective because it considers the close association between humans and non-humans in the communication process as a human condition.
In the current media environment, as the participation of non-humans, including the technological artifacts of the deceased, in communication increases, the possibility of non-humans intervening in what was once considered the monopoly of humans — natural time — and reconfiguring “time,” has also been expanding. Along with the shift in perspective toward re-conceptualizing humans as “so-called Man” beyond the modern humanistic concept of humans, this is a reason to re-examine time experiences. In this context, a cybernetic worldview is appropriate for observing the impact of communication with non-humans on the human experience of time.
In this study, which selected the medium theory and cybernetics as its main theoretical frameworks, Francesco Casetti's “Three Worlds” and John Johnston’s “Machinic Life” were applied as the conceptual resources to analyze actual media texts and interpret the implications of the results. The researcher addressed the first research question by analyzing cases of media texts that presented the deceased's technological artifacts through virtual reality media, based on the medium theory with remediation logic, within the conceptual framework of the “three worlds” in relation to time experiences. Casetti's “three worlds” is a concept that considers both the attributes of the optical and environmental dimensions as sub-dimensions of the media properties, which helps to analyze the variations in time experiences related to the production and acceptance of media texts in a three-dimensional manner, as well as the principles of the media embodying technological artifacts.
By applying the “three worlds” concept, this study analyzed “VR Human Documentary – Meeting You” and “Science of Affect and Sensibility – Reincarnation,” which presented the deceased's technological artifacts through virtual reality media such as head-mounted display (HMD) and holograms, respectively. The analysis results are as follows. First, time experiences are influenced by how the “three worlds” relate to each other, as seen in the functional arrangement and combination patterns of screen components. Both media texts share the distinctive feature of virtual reality media texts in that they make the deceased's otherworld present as a “potentially living persistence,” but the mechanisms and effects of their implementation differ. In “VR Human Documentary - Meeting You,” the HMD helmet covered the audience's field of vision, and the deceased's otherworld was made present on its screen using artificial light alone, thereby enhancing immersion. In contrast, in “Science of Affect and Sensibility – Reincarnation,” the deceased's otherworld was experienced as if in the real world's space-time because of the non-mediation of the screen made of translucent foil. In particular, the balanced arrangement of the screen's medium and elements played an important role in this time experience.
The media producers of “Science of Affect and Sensibility – Reincarnation” employed the physical world of nature as a public space — a hologram live venue — and bound the audience together as a collective subject through communication with the deceased's technological artifacts. This further strengthened the layers of time as “performativity” and “synchronicity” entered and remediated from the magic lantern.
The media producers of “VR Human Documentary – Meeting You” designed the movement path to intersect “freedom” and “inducement,” enabling the audience to move together with the screen in the physical world of nature. As the audience as the “information media” moved, new spatiotemporal dimensions unfolded on the screen, renewing the time experiences, the physical world of nature expanded, and the HMD experience was remediated into television, leading to the expansion of the screen along with the multi-layering of the audience. In the hologram media text “Science of Affect and Sensibility – Reincarnation,” the expansion of the audience and the screen induces multi-layered time experiences through virtual synchronization.
As the physical world of nature expanded into an extended space-time through the overlap of the real and virtual worlds, the otherworld of the deceased was made present, and the inner world of the audience also underwent significant changes in time experiences. As for “VR Human Documentary – Meeting You,” the intensification of affective effects from the micronization of time intervals could be explained by the concept of “feed-forward.” In particular, the basic premise of the affective effect was the existence of a screen onto which images were projected in finely fragmented time intervals. Another factor that increased the intensity of the time experiences in the audience's inner world was the evocation of synesthesia. The effect of synesthetic evocation by activating touch and hearing was also found in “Science of Affect and Sensibility - Reincarnation.” Through the movement of reaching out toward the hologram and the conversation being made present, it was confirmed that the feeling of existing contemporaneously with the deceased through their technological artifacts in the audience's inner world could be strengthened. Furthermore, the audience of “Science of Affect and Sensibility – Reincarnation” experienced the times of the “three worlds” being synchronized into the “Here and Now” through the entry of an “outside temporality” that does not belong to anywhere — real or virtual place.
By analyzing media texts through the conceptual framework of the medium theory and the “three worlds,” clues regarding the impacts of communication with the deceased's technological artifacts mediated by virtual reality media on time experiences were discovered in the media properties. Meanwhile, the attributes of “machinic life” based on cybernetics were useful for understanding the system in which the layers of time were more dynamically reconstructed in the current media-environment, thereby expanding the scope and effects of new experiences of time. The researcher set the second research question: how to reinterpret human experiences of time by analyzing media texts using the attribute of machinic life as a conceptual resource and applying the result.
First, the researcher conceptualized the deceased's technological artifacts, which were presented by virtual reality media, as “machinic life” in that they were born, adapted, and evolved within computational networks, which is a comprehensive media environment of computer programs and networks. As a result of analyzing in-depth interview responses, it could be interpreted that the media producers and audience who participated in this study also recognized the technological artifacts of the deceased as an identity as “machinic life” rather than as “machinic Other.” This attitude can serve as a basis for producers to fully utilize or for the audience to naturally accept the capability of the deceased's technological artifacts to communicate with humans, as “machinic life.”
The results of the media text analysis based on the attributes of “machinic life” as conceptual resources are as follows. First, in “VR Human Documentary – Meeting You” and “Science of Affect and Sensibility – Reincarnation,” the deceased’s technological artifacts were able to be born as “machinic life” because the memories of the deceased were converted to digital data and existed as “means other than life.” In other words, from their birth, they exist as beings that traverse the boundaries between humans and non-humans, blurring the boundaries between life and death, past and present, artificial and natural; as the media environment evolves, they evolve with humans, making time experiences colorful through communication. There were scenes, which can be considered as examples showing possibilities of new layers of time being inscribed in communication with “machinic life” as follows: First, in “VR Human Documentary – Meeting You,” the scene where “machinic life” looks at the deceased’s photo and takes a picture with the audience to leave a record of “existence.” Second, in “Science of Affect and Sensibility – Reincarnation,” the scene where “machinic life” looks at the archives of the modern and contemporary history of the time when the deceased was absent.
The second attribute of “machinic life,” recursive interaction, was analyzed based on visual information from media producers who participated in in-depth interviews. In “VR Human Documentary – Meeting You,” not only the deceased's technological artifacts but also the audience's body, equipped with a spatiotemporal tracking device and experiencing the narrative through an HMD, functioned as information media, continuing to “move” within the computational network. This part indicates that the audience's body could be regarded as a kind of “machinic life.” The audience’s experience of time was constantly reconstructed through the recursive interaction between the two machinic lives and between “machinic life” and the media environment. In “Science of Affect and Sensibility – Reincarnation,” “machinic life” resides in the computational network, adapts and evolves, and eventually engages in the reconstruction of the media-environment, thereby acquiring the potential competence to influence the time experiences of humans through the recursive interaction.
The reconstruction of the audience’s layers of time based on the attributes of “machinic life” was most evident in the scene where “abstract machines” realized “virtuality.” For instance, in “VR Human Documentary – Meeting You,” the HMD audience struggles by trying to embrace “machinic life” in a scene, which can be interpreted as a case of realizing the virtual, and strengthening affective effects through reconstructed layers of time. The researcher targeted this scene for analysis, and was able to visualize the overlapping patterns of the actual and the virtual in communication with “machinic life” by manipulating non-linear editing software to attempt a process similar to that of media producers. In “Science of Affect and Sensibility – Reincarnation,” the media properties of holograms allowed for overlapping the actual and the virtual throughout the media text. Both virtual reality media texts exhibited in the communication process with “machinic life” that the time could be reconstructed as a “thick present” by turning the potential into reality.
The ability of “machinic life” to construct a “new reality” through an integration of the virtual and the real could be explained by the concept of “spime.” Spime — a compound word of time and space — is both a virtual and real object; it was realized in the analyzed media text through the radio-frequency identification (RFID) technique. In particular, as the time presented by spime is “time of duration,” not only the encounter with “machinic life” that began by making the otherworld of the deceased present but also the separation that unfolded after the interaction process, could enter a realm of new time experiences. This implies that the time experiences reconstructed in the communication process between humans and non-humans may potentially shift from the past-present to the present-future.
The new time experiences generated from “becoming-machinic,” which is the final attribute associated with “machinic life,” can be found in the attempt to fully reflect “machinic vision” in “VR Human Documentary – Meeting You.” In the scene where the audience makes conversation while viewing the technological artifacts of the living, with the deceased in the same line, the layers of time are presented much more multi-layered than in other scenes. In “Science of Affect and Sensibility – Reincarnation,” the audience collaborated with “machinic life” in a scene, which shows the pattern where the human audience was adjusting to the rhythm and tempo of “machinic life.” The implications of this new time experience induced by becoming-machinic can be interpreted at the intersection with the themes of post-humanism.
This study analyzed media texts using the concept of the “three worlds” associated with the medium theory, as well as the attributes of “machinic life” based on cybernetics as the main conceptual resources. Consequently, it was confirmed that layers of time were distinctively inscribed and reconstructed according to media properties, and the media-environment can amplify the effects of time experiences. This study emphasizes that in today's media-environment comprising computational networks, not only humans but also non-humans, including “machinic life,” participate in communication, thereby transforming the time experienced by humans beyond the range they are accustomed to. In this context, research exploring the phenomenon where non-human entities induce the experiences of time reconstruction through communication, could serve as an attempt to promote a novel understanding of communication and time experiences from the perspective of the “so-called Man,” which breaks away from the modern humanistic concept of humans.