Transmedia: an improvisualization

The transformation of physical phenomena into data —the pass from analog to digital— has played an important role in expanding our understandings of what is art and what it means to be an artist. This transformation has also changed the way we understand and perform with media and has opened innumerable avenues for experimentation within and across different forms of representation. The outcomes of this experimentation could illuminate our knowledge of creative processes.

As part of our research on glitch pedagogy and transmediation over the last two years (Peña, James & DLC, 2016), we have experimented with the functionalities of raw data by comparing patterns of mis/representation between textual, aural and visual data. Our inquiries have allowed us to engage in the intervention and purposeful disruption of these patterns while shedding light on the underlying processes behind these disruptive practices. Delivered as a performance, this paper will demonstrate a few such practices.

In our role as noise-musicians, we will improvisualize a transmediatic piece while describing the process behind it. This performance/presentation will start with the production of a natively visual digital artifact (i.e., a digital photograph). This artifact, produced during the session involving attendees, will be then translated into while modifying the sound with analog synthesizers. Simultaneously poetry will be performed, recorded and interpolated with the raw data of the pictures’ sound file. This step will effectively involve passing digital data through an analog channel before its re-digitization in real-time. Finally, the intervened artifact will then be re-presented in its visual form.

Our presentation will not only contrast between performance as a process and performance as a product, it will allow participants to compare the aesthetic properties of an artifact when presented both in a native and in a non-native format, and will reveal the patterns-in-common between these different media by merit of disrupting them.

Peña, E., James, K., & Takeda, Y. (2018). Transmediation: An improvisualizaton. Presented at the Electronic Literature Organization Conference, Montreal.