In this paper, the authors present the initial findings from explorations on transformation patterns of data in raw format when crossing or transmediating directly (i.e., unaffected by any other form of codification) between audio and visual media. These patterns have allowed the authors to engage in the production of transmediatic artifacts with some degree of control and agency, facilitating purposeful applications of transmediation. The products of such practices will enable a form of literacy, an aesthetic means to identify in visual media artifacts those patterns that could transmediate into useful or appealing sonic artifacts and vice versa.
This article is currently available here.
https://www.mitpressjournals.org/doi/abs/10.1162/leon_a_01635
Peña, E., & James, K. (2020). Raw Harmonies: Transmediation through Raw Data. Leonardo, 53(2), 183-188