How we locate sound in real life
People work out where a sound is from small differences between what reaches each ear. A sound on your left arrives at the left ear slightly sooner and slightly louder than at the right ear. The head also blocks and filters some of the sound, and the shape of the outer ear changes the tone depending on the direction it comes from. The brain combines these small clues, along with distance cues such as volume and echo, to build a sense of where something is.
Games try to recreate this. Because the game knows where every sound source and the listener are in its virtual space, it can calculate how each sound should be adjusted. The result is positional sound, which is a basic part of spatial audio.
The basic ingredients
Panning. The simplest tool: send more of a sound to the left or right speaker depending on where the source is. This works in plain stereo and gives a clear left-right sense, though it says little about front, back or height.
Volume and distance. Sounds get quieter as they move away. Games use an attenuation curve, a rule for how volume falls with distance. Designers adjust the curve to taste: a realistic drop-off might make distant events inaudible, while a more generous curve keeps important sounds audible further away.
Filtering. Distant sounds lose their high frequencies, so they sound duller. Applying a gentle filter that increases with distance makes the distance feel more convincing than volume alone.
Reverb. The balance of direct sound and echo gives clues about distance and space. A nearby sound is mostly direct; a distant one has relatively more echo. Reverb settings also describe the room: a cave, a corridor and an open field each have a different character.
Delay and Doppler effects. Sound takes time to travel. Some games add a small delay for distant events, or change pitch for a fast-moving source as it passes, as with a vehicle going by.
Stereo, surround and headphones
Stereo uses two channels and is good at left-right placement. Surround systems add extra speakers around the listener, such as the commonly used 5.1 and 7.1 layouts, which allow sounds to be placed behind and beside the player. Some formats add overhead speakers to give a sense of height.
Many players use headphones, which has led to widespread use of binaural processing. This applies filters, based on measurements of how sound reaches the ears, to create the impression of sounds coming from outside the head, including from behind or above. Results vary between people, because ears and heads differ in shape. Some listeners find the effect convincing, others find it less so, which is why many games let players choose among settings.
Occlusion and obstruction
A sound behind a wall does not simply sound quieter. It sounds muffled, with the high frequencies reduced. Games model this in two main ways:
- Obstruction. Something partly blocks the direct path, such as a pillar, but sound can still reach the listener around it.
- Occlusion. The sound is fully blocked by solid objects, and only a muffled version gets through.
This is usually handled with simple checks of what lies between the source and the player. Even a simple version adds a lot: hearing footsteps through a door, and then more clearly when it opens, gives the player useful information about the space. It connects with the kind of geometry checks used in collision detection, though audio usually needs far less precision.
Why position matters for play
Spatial sound is more than polish. In many games it is a tool for playing well. In shooter games, hearing where footsteps come from lets players anticipate opponents. In horror and stealth games, a sound behind you builds fear and tension. In racing games, hearing the engine of a car approaching from behind helps a player judge their next move. Direction can also support level layout, drawing attention toward an objective or a hidden path.
Because position can carry gameplay information, designers need to be careful about fairness. If an important sound is poorly positioned, or if it can only be located by players with particular equipment, those without that equipment are at a disadvantage.
Limits and trade-offs
Spatial audio has real limits, and designers work around them.
- Front-back confusion. In stereo and headphones, it can be hard to tell whether a sound is in front or behind. Adding visual cues, or subtle filtering, can help.
- Height. Judging whether a sound is above or below is difficult without special systems.
- Equipment. Players use anything from phone speakers to home cinema systems. Positioning that works with good headphones may be lost on a TV speaker.
- Clarity over realism. A perfectly realistic sound field can be confusing. Designers sometimes exaggerate direction or distance so that it is easier to read.
Accessibility
Not every player can use positional sound. Some players are deaf in one ear, and others cannot hear at all. Games that rely on direction should offer an alternative, such as a visual indicator on the screen that shows the direction of a sound. Options for mono output, which combines both channels, can help players with hearing in one ear. These choices are part of the wider topic of game accessibility, and they should be tested with the people who need them.
Testing
Positional audio is best tested by playing with several setups: headphones, stereo speakers and, where available, surround. Ask testers to close their eyes, or to point at where they think a sound is coming from. Their guesses show whether the design is giving the information intended. It is also worth checking that moving sounds, doors and room changes behave smoothly, without sudden jumps in volume or tone.