Auralization Applying The Parametric Room Acoustic Modeling Technique - The Diva Auralization System
Auralization Applying The Parametric Room Acoustic Modeling Technique - The Diva Auralization System
Auralization Applying The Parametric Room Acoustic Modeling Technique - The Diva Auralization System
ICAD02-1
Proceedings of the 2002 International Conference on Auditory Display, Kyoto, Japan, July 2-5, 2002
design goal in reverberators is similar to the one in auralization Coordination Acoustique/Musique) in France. For example, they
systems; to model a decaying sound field by producing a dense have created a spatializer tool, Spatialisateur, for musicians with
pattern of reflections. perceptual modeling approach [20, 21, 22]. Especially, they have
Nowadays computers are widely applied to help in room acous- developed signal processing algorithms for efficient rendering and
tic design. Most of the available applications for this purpose also for real-time systems.
have their own module for auralization. Computational modeling
of room acoustics and auralization has been the main area of re- 2.2. History and design goals of the DIVA auralization system
search for the following organizations:
One of the first attempts to model room acoustics and re-
At the Helsinki University of Technology (HUT) research on room
acoustic modeling and 3-D sound reproduction has been conducted
alize binaural auralizations of concert halls was realized in since early 1990s. In 1994 first attempts to combine these efforts
the Centre Scientifique et Technique du Batiment, France, were made. Since then we have developed the Digital Interactive
[4, 5]. In addition, they were one of the firsts who proposed Virtual Acoustics (DIVA) auralization system for room acoustic
separate modeling of early reflections and statistical late re- modeling aiming at both real-time and non-realtime auralization.
verberation.
In the first DIVA auralization system we applied a dedicated
In the Technical University of Denmark, research on mod- DSP-processor for auralization, but already in 1994 we also had
eling of concert hall acoustics and auralization [6] has led an implementation running on a UNIX-workstation, and after that
to the room acoustic modeling program called Odeon2 . we have been working entirely without any special hardware. In
A lot of research on modeling of reflections as well as ba- the original version, headphone reproduction was applied, but cur-
rently both multichannel reproduction with loudspeakers and bin-
sic research on auralization methods has been conducted in
the Chalmers University of Technology, Sweden, [1, 7]. As aural reproduction with headphones are supported.
a product of these studies the room acoustic modeling pro- The DIVA auralization system has been a part of a more com-
gram, CATT Acoustic3 , including auralization, has been de- plex system aiming at virtual concert performance. As a result we
veloped. Recently, they have studied edge diffraction mod- had our own virtual orchestra. The first public performance of the
eling successfully [8]. DIVA virtual orchestra was in 1997 in SIGGRAPH97 conference
in Los Angeles. Another demonstration of the DIVA auralization
The room acoustic simulation program EASE/EARS in- system was the Marienkirche video presenting the acoustic design
cluding auralization has been developed by the Acoustic of a concert hall. The video was presented in the Electronic The-
Design Ahnert4 , Germany, [9]. ater of SIGGRAPH98 conference [23], and after that it has been
In the University of Parma, Italy, a lot of research on con- shown on several TV-channels worldwide.
cert hall and automotive acoustics, and sound systems in-
side cars [10] has been executed. In addition, they have 3. ROOM ACOUSTIC MODELING AND AURALIZATION
produced the room acoustic modeling software Ramsete5 .
The following research units have had a significant impact on In room acoustic modeling the propagation of sound waves in a
the field of 3-D sound reproduction: space is under study. This can be divided into two subparts: mod-
eling of the actual propagation and modeling of reflections from
In the Ruhr-Universitat Bochum, Germany, a lot of basic boundaries of a space. The modeling of wave propagation is quite
research in room acoustic modeling and especially in hu- straightforward. In a free space each sound source emits a spher-
man spatial hearing has been done [11, 12]. In addition, ical wavefront, i.e., an elementary wave, that propagates homo-
they have their own auralization system [13, 14]. geneously in all directions. The amplitude of sound is inversely
In the NASA-Ames Research Center, USA, the research has proportional to the distance from the sound source. Modeling of
reflections is a bit more challenging. In each reflection a new
been driven by the interest to directional hearing and real-
time systems [15, 16]. Recently, they have been building a wavefront is created, and the reflections can be modeled as new
real-time auralization tool, SLAB [17], for interactive spa- sound sources. Therefore it is possible to reduce the model such
tial sound research. that recursively in each reflection a new sound source is created.
Finally we have only sound sources, but no reflections. In actual
Binaural technology and HRTF measurement methods have modeling the effect of each source is composed to produce the fi-
been developed extensively in the Aalborg University, Den- nal sound field in the listening positions. However, some of these
mark [18]. secondary sources are not visible to a listening point due to occlu-
Research on artificial reverberators and auralization have sion by surfaces. For this reason validity of all sources is verified
been carried out since 1992 in the Massachusetts Institute of with a visibility check. One of the most commonly applied room
Technology, USA, [19]. Further development of this work acoustic modeling techniques is called the image source method
has led to pro audio softwares by Wave Arts6 . [24], and it is based on this approach.
Figure 2 illustrates this concept of sound field decomposition
The leading research institute concerning perception-based real- [25]. Each reflection from a wall is replaced with an image source
time auralization has been the IRCAM (Institut de Recherche et and each corner (except convex rectangular corners) is replaced
2 http://www.dat.dtu.dk/ ~odeon/ with an edge source. All of these secondary sources emit a wave-
3 http://www.catt.se/ front that are shown inside the geometry. With the concept of im-
4 http://www.ada-acousticdesign.de/ age sources each elementary wave can be easily filtered with fre-
5 http://www.ramsete.com/ quency dependent acoustic phenomena such as sound source di-
6 http://www.wavearts.com/ rectivity, distance delay and attenuation, air, material, and wall ab-
ICAD02-2
Proceedings of the 2002 International Conference on Auditory Display, Kyoto, Japan, July 2-5, 2002
second order
...
image source ...
sound
source
ICAD02-3
Proceedings of the 2002 International Conference on Auditory Display, Kyoto, Japan, July 2-5, 2002
1
0
0
1
00000
11111
00000
11111
00000
11111
R 11111
00000
z1
00000
11111 Top view
00000
11111
00000
11111
00000
11111
00000
11111 11111
00000
00000 R
11111 000000
111111
00000
11111 z1
000000
111111
00000
11111
000000
111111
00000
11111
receiver
000000
111111
00000
11111 sound position r2
n 000000
111111
00000
11111 source
l 000000
111111
00000
11111
000000
111111
00000
11111
R 000000
111111
00000
11111
00
11 000000
111111
00000
11111 m
00
11 000000
111111
11111
00000 000000
111111
00000
11111 000000
111111
w S 11
00000
1111100 S 000000
111111
00000
1111100
11 000000
111111
z apex
000000
111111 receiver
00
11 000000
111111
z0 000000
111111 position r1
000000
111111
000000S
111111
000000
111111 0
1
000000
111111 0
1
z0
ICAD02-4
Proceedings of the 2002 International Conference on Auditory Display, Kyoto, Japan, July 2-5, 2002
ANECHOIC STIMULUS nificant differences between the grades given to spatial and timbral
properties. Signals having sustained total characteristics such as
sound of a clarinet were judged with the best grades. With sig-
MODELING
nals having transients such as a hit of a snare drum the differences
LOUDSPEAKER 3D model of a room were clearly audible but on the average they were evaluated to be
IN REAL ROOM image source calculation plausible and natural sounding.
diffraction
source directivity filters
REALHEAD material filters
5. FUTURE GUIDELINES
OR MONOPHONIC air absorption filters
RECORDING HRTF filters The current modeling techniques applied typically in room acous-
late reverberation tic design are based on the geometrical acoustics. In the future, the
phenomena caused by the wave-nature of sound should be mod-
parameters eled more carefully. This can be done either by employing some
AURALIZATION wave-based model such as the digital waveguide mesh [33], or by
REALHEAD adding their modeling into existing ray-based systems.
DIVA software OR MONOPHONIC
The next major improvement to the DIVA auralization system
RECORDING
will be modeling of diffusion. In general, diffusion plays an im-
background portant role in room acoustics. For example, in concert halls the
noise sidewalls are typically made to be diffusive rather than specularly
reflecting. Our approach to this problem will be to incorporate dif-
binaural or binaural or
fusion into the image-source method by using surface sources base
monophonic monophonic
recording auralization
on the ideas suggested by Dalenback [34]. In addition, we are go-
ing to further enhance the auralization quality by continuing both
subjective and objective evaluations.
COMPARISON
OF SOUNDTRACKS
6. CONCLUSIONS
ICAD02-5
Proceedings of the 2002 International Conference on Auditory Display, Kyoto, Japan, July 2-5, 2002
[5] D. van Maercke, Simulation of sound fields in time and fre- [21] J.-M. Jot, An analysis/synthesis approach to real-time artif-
quency domain using a geometrical model, in Proc. 12th Int. ical reverberation, in Proc. 1992 IEEE Int. Conf. Acoust.,
Congr. Acoust. (ICA86), Toronto, Ont., Canada, July 1986, Speech, and Signal Processing, San Francisco, CA, March
vol. 2, paper E11-7. 1992, vol. 2, pp. 221224.
[6] G. M. Naylor, ODEON another hybrid room acoustical [22] J.-M. Jot, Etude et realisation dun spatialisateur de sons
model, Applied Acoustics, vol. 38, no. 2-4, Special Issue par modeles physique et perceptifs, Ph.D. thesis, lEcole Na-
on Computer Modelling and Auralisation of Sound Fields in tionale Superieure des Telecommunications, Telecom Paris,
Rooms, pp. 131143, 1993. Sept. 1992.
[7] B.-I. Dalenback, A New Model for Room Acoustic Predic- [23] T. Takala, E. Rousku, T. Lokki, L. Savioja, J. Huopaniemi,
tion and Auralization, Ph.D. thesis, Chalmers Univ. of Tech., R. Vaananen, V. Pulkki, and P. Salminen, Marienkirche - a
Gothenburg, Sweden, 1995. visual and aural demonstration film, in Electronic Art and
Animation Catalogue (SIGGRAPH98), Orlando, FL, July
[8] U.P. Svensson, R.I. Fred, and J. Vanderkooy, Analytic sec- 1998, p. 149, Presented in SIGGRAPH98 Computer Ani-
ondary source model of edge diffraction impulse responses, mation Festival (Electronic Theater).
J. Acoust. Soc. Am., vol. 106, no. 5, pp. 23312344, 1999.
[24] J. B. Allen and D. A. Berkley, Image method for efficiently
[9] W. Ahnert and R. Feistel, EARS auralization software, J. simulating small-room acoustics, J. Acoust. Soc. Am., vol.
Audio Eng. Soc., vol. 41, no. 11, pp. 894904, Nov. 1993. 65, no. 4, pp. 943950, 1979.
[10] A. Farina, Verification of the accuracy of the pyramid trac- [25] U.P. Svensson and U.R. Kristiansen, Computational mod-
ing algorithm by comparison with experimental measure- eling and simulation of acoustic spaces, in Proc. AES 22nd
ments of objective acoustic parameters, in Proc. 15th Int. Int. Conf. on Virtual, Synthetic and Entertainment Audio, Es-
Congr. Acoust. (ICA95), Trondheim, Norway, June 1995, poo, Finland, June 15-17 2002.
pp. 445448. [26] J. Borish, Extension of the image model to arbitrary poly-
[11] H. Lehnert and J. Blauert, Principles of binaural room sim- hedra, J. Acoust. Soc. Am., vol. 75, no. 6, pp. 18271836,
ulation, Applied Acoustics, vol. 36, no. 3-4, pp. 259291, 1984.
1992. [27] L. Savioja, J. Huopaniemi, T. Lokki, and R. Vaananen, Cre-
[12] J. Blauert, Spatial Hearing. The Psychophysics of Human ating interactive virtual acoustic environments, J. Audio
Sound Localization, MIT Press, Cambridge, MA, 2nd edi- Eng. Soc., vol. 47, no. 9, pp. 675705, Sept. 1999.
tion, 1997. [28] L. Savioja, J. Huopaniemi, T. Lokki, and R. Vaananen, Vir-
[13] J. Blauert, H. Lehnert, J. Sahrhage, and H. Strauss, An inter- tual environment simulation - advances in the DIVA project,
active virtual-environment generator for psychoacoustic re- in Proc. Int. Conf. Auditory Display (ICAD97), Palo Alto,
search. I: Architecture and implementation, Acustica united CA, Nov. 1997, pp. 4346.
with Acta Acustica, vol. 86, no. 1, pp. 94102, 2000. [29] T. Lokki, P. Svensson, and L. Savioja, An efficient auraliza-
tion of edge diffraction, in Proc. AES 21st Conference on
[14] T. Djelani, C. Prschmann, J. Sahrhage, and J. Blauert, An
Arhitectural Acoustics and Sound Reinforcement, St. Peters-
interactive virtual-environment generator for psychoacous-
burg, Russia, June 2002.
tic research. II: Collection of head-related impulse responses
and evaluation of auditory localization, vol. 86, no. 6, pp. [30] R.R. Torres, U.P. Svensson, and M. Kleiner, Computation
10461053, 2000. of edge diffraction for more accurate room acoustics aural-
ization, J. Acoust. Soc. Am., vol. 109, no. 2, pp. 600610,
[15] S. Foster, E. Wenzel, and R. Taylor, Real-time synthesis of 2001.
complex acoustic environments, in Proc. IEEE Workshop
on Applications of Signal Processing to Audio and Acoustics, [31] T. Lokki, J. Hiipakka, and L. Savioja, A framework for
Mohonk, New Paltz, NY, 1991. evaluating virtual acoustic environments, in the 110th Au-
dio Engineering Society (AES) Convention, Amsterdam, the
[16] D. Begault, 3-D Sound for Virtual Reality and Multimedia, Netherlands, May 2001, preprint no. 5317.
Academic Press, Cambridge, MA, 1994.
[32] ITU-R, Recommendation BS.1116-1, Methods for the
[17] E. M. Wenzel, J. D. Miller, and J. S. Abel, Sound lab: subjective assessment of small impairments in audio sys-
A real-time, software-based system for the study of spatial tems including multichannel sound systems, International
hearing, in the 108th Audio Engineering Society (AES) Con- Telecommunication Union Radiocomminication Assembly,
vention, preprint no. 5140, Paris, Feb. 2000. 1997.
[18] H. Mller, Fundamentals of binaural technology, Applied [33] L. Savioja and V. Valimaki, Interpolated 3-D digital waveg-
Acoustics, vol. 36, no. 3-4, pp. 171218, 1992. uide mesh with frequency warping, in Proc. Int. Conf.
Acoust., Speech, Signal Processing, Salt Lake City, UT, May
[19] W. Gardner, Virtual acoustic room, M.S. thesis, MIT,
2001.
1992.
[34] B.-I. Dalenback, Room acoustic prediction based on a uni-
[20] J.-M. Jot and A. Chaigne, Digital delay networks for de- fied treatment of diffuse and specular reflection, J. Acoust.
signing artificial reverberators, in The 90th Convention of Soc. Am., vol. 100, no. 2, pp. 899909, Aug. 1996.
the Audio Engineering Society, Paris, France, 1991, preprint
3030.
ICAD02-6