Professional Documents
Culture Documents
_202 _203
scales. Enhancing this basic functionality is the ability 9. AESTHETIC RESULTS [3] Leudar, A. Personal email communication.
to bring the full power of sophisticated image 2012.
In “Space-form and the Acousmatic Image,” Denis
processing software to bear on the creation of spatial [4] Kendall, G. and Cabrera, A. “Why Things
Smalley defines space-form as “An approach to musical
properties. Modern spatialization software packages Don’t Work: What You Need to Know About
form, and its analysis, which privileges space as the
such as Zirkonium [9] nonetheless still conceptualize Spatial Audio” Proceedings of the International
primary articulator. Time acts in the service of space”
panning as the linear motion from one location to Computer Music Conference. Huddersfield,
[10]. In the same article, Smalley makes a distinction
another. With image-based spatialization, a line could UK, 2011.
between interventionist and naturalist approaches. “With
gradually increase in thickness, darkness, or bifurcate. [5] Marino, G., Serra, MH., and Raczinski, JM,
the interventionist approach the composer’s hand is in
Patterns can be complicated with the addition of noise. “The UPIC System: Origins and Innovations,”
evidence, and the stamp of the technology and
Segments of trajectories can be blurred, or subjected to a Perspectives of New Music 31(1): 258-269.
techniques is apparent in the kind of material and the
wide range of other image filtering process. This allows 1993.
way it is manipulated, whereas in the naturalist work
the composer to shape the evolution of spatial properties
there will be some attempt to hide techniques, and avoid [6] McGee, R. and Wright, M. “Sound Element
in a detailed manner, since it is easy to apply filters to
exposing technological signifiers” [10]. Spatialization,” Proceedings of the
small segments of a larger spatial trajectory. Practically
Spaced Images with Noise and Lines could International Computer Music Conference,
speaking, the relationship between the image and the
accurately be described as an interventionist space-form Huddersfield, UK, 2011.
resulting spatial effect is rarely isomorphic; the cautions
composition. From the outset, the spatial aspect of the
about spatial composition provided by Kendall and [7] Oram, D. “Oramics,”
work is kept in the compositional foreground through
Cabrera remain in effect [4]. However, often enough the http://daphneoram.org/oramarchive/oramics/
dramatic panning trajectories. Sonic elements are
results of the process are predictable, and musically [8] Penrose, C. “HyperUpic” (1991, no longer
deliberately kept simple throughout in order to highlight
effective. More importantly, the spatial results described publicly available)
the spatial aspect. Different approaches to texture
here would be difficult or impossible to achieve using http://www.music.princeton.edu/~penrose/soft/
creation, and the admixture of noise and lines in the
more traditional control interfaces for spatialization, [9] Ramakrishnan, R. “Zirkonium”.
images, provide a broad variety of spatial experiences to
which tend to focus on the locations or trajectories of http://ima.zkm.de/zirkonium/ZirkoniumManual.
the audience. Perhaps most importantly, the spatial
coherent sonic objects within a desired spatial pdf
structures are integral to the music. The complexity of
environment. [10] Smalley, D. “Space-form and the Acousmatic
the spatial relations is built into the musical structure; it
Image” Organised Sound 12(2): 107-126. 2007.
could not have been imposed externally through
8. COMPARISONS WITH VIDEO-BASED [11] Stockhausen, K. Studie II: Nr. 3 Elektronische
performed manual diffusion techniques.
SPATIALIZATION Studien, Universal Edition, 1956. Vienna.
[12] UISoftware. MetaSynth.
Spatialization with video would seem to have certain 10. FUTURE WORK
“http://www.uisoftware.com/MetaSynth”
advantages over image-based spatialization. For
Only greyscale image processing was used in Spaced
example, there is a more direct conceptual mapping
Images with Noise and Lines. It would be interesting to
between an individual video frame, and a surround
use the separate RGB channels to affect different
speaker array, at least for 2D surround sound arrays.
aspects of synthesis, and/or spatialization. The use of
Video lends itself to real-time processing in a way that
image masks could facilitate the creation of various
is unavailable for image-based spatialization. However,
forms of spatial polyphony. The mapping described here
the temporal association between the video and audio is
makes the most sense in the context of 2D speaker
a mixed blessing. Images used for spatialization are not
arrays. A rethink of the spatial image mapping strategy
to be viewed during performance, and therefore their
may be appropriate for 3D arrays, such as the Klangdom
aesthetic qualities need not be considered. (Of course it
at ZKM, or the Sonic Lab at SARC.
is possible to create video-based spatial sound in which
the video itself is not presented to the audience.
11. CONCLUSIONS
However, every example I have encountered of video-
based audio spatialization has been presented as an
integrated audio-visual composition.) In audio-visual The technique of image-based spatialization was
work, the imagery must be as aesthetically strong as the discussed in the context of the author’s composition
sound, and the two must work well together. This Spaced Images with Noise and Lines. The creative
requirement could put constraints on the content of the potentials of the technique were shown to be somewhat
video. A situation in which both audio and video are different from more traditional trajectory-based
presenting the same information introduces the danger spatialization techniques. Given the growing number of
of aesthetic redundancy. Applying filters to modify multi-channel performance venues, and opportunities
spatial behavior is much easier and more direct for for composers and audiences to explore spatial music,
image processing than for video processing. techniques such as image-based spatialization may be of
Nonetheless, video-based spatialization can still be quite increasing interest to composers of computer music.
effective, especially when drawing on the advantages of
live performance. In any case, despite some overlap in 12. REFERENCES
the manner of data processing, video-based [1] GNU. “The Gimp.” http://www.gimp.org/.
spatialization and image-based spatialization remain two [2] Greenlee, S. Personal email communication.
distinctly different approaches to spatialization. 2011.
_202 _203