How can you use procedural audio in games?

1 What is procedural audio?

Procedural audio is a term that covers various methods of synthesizing sound from scratch, using algorithms, parameters, and data. It can be contrasted with sample-based audio, which uses recorded sound clips that are triggered and manipulated by the game engine. Procedural audio can create sounds that are not possible or practical to record, such as alien creatures, futuristic weapons, or complex environments. It can also respond to the game state and the player's actions, creating a more interactive and realistic audio experience.

2 How does procedural audio work?

There are various techniques for implementing procedural audio in games, depending on the desired sound. Physical modeling, granular synthesis, subtractive synthesis, and additive synthesis are all common methods. Physical modeling can be used to create realistic wind instruments, drums, or bells. Granular synthesis can be used to generate fire, water, or crowd sounds. Subtractive synthesis can be employed to craft electronic or robotic sounds. Finally, additive synthesis is useful for producing organic or harmonic sounds.

3 What are the benefits of procedural audio?

Procedural audio offers several advantages over sample-based audio, such as memory and disk space savings, dynamic and adaptive sounds, and creative and experimental sounds. Procedural audio can generate sounds on the fly, without relying on large sound files or libraries, reducing the load on the game engine and the storage device. It can also react to the game state and the player's input, creating sounds that are appropriate for the context and the mood. Moreover, it can create unique, original, or unexpected sounds that add to the immersion and aesthetic of the game, such as those influenced by the player's emotions, actions, or choices.

4 What are the challenges of procedural audio?

Procedural audio can be a difficult and challenging process, as it requires a lot of programming, math, and sound design skills. Furthermore, it can consume a lot of CPU and GPU resources, depending on the complexity of the sounds that are generated. Additionally, procedural audio may cause latency, glitches, or crashes if the game engine or audio middleware are not optimized or compatible with the system. Moreover, it can produce unfamiliar or inconsistent sounds that can confuse or frustrate the player, as well as clash with their expectations or preferences. Thus, it is important to consider these drawbacks when utilizing procedural audio.

5 How can you get started with procedural audio?

If you’re interested in learning more about procedural audio, or trying it out for yourself, there are several resources and tools available. You can find books and articles that cover the theory and practice of procedural audio, such as "Designing Sound" by Andy Farnell and "The Sound of No Man's Sky" by Paul Weir. Additionally, there are software and libraries that allow you to create and integrate procedural audio in games, such as Pure Data, Wwise, FMOD, SuperCollider, or Unity. Furthermore, there are tutorials and examples that show you how to use procedural audio in games, such as "How to Create Procedural Audio in Unity" by Brackeys or "Creating Procedural Audio with Wwise" by Audiokinetic.

6 Here’s what else to consider

This is a space to share examples, stories, or insights that don’t fit into any of the previous sections. What else would you like to add?