7Many Notes at Once: Harmony and Polyphony

TWhy simultaneous pitches collapse

Resolving two notes sounding together requires placing their harmonics on separate, well-defined channels; an implant offers only a dozen or so broad, overlapping channels, so concurrent pitches land on the same electrodes and merge. When several notes overlap, the device transmits the combined envelope on each channel rather than the individual partials, so the listener hears one fused, roughened sound instead of distinct simultaneous pitches. Place-pitch cues become ambiguous with simultaneous tones because current spread from neighbouring electrodes overlaps, and the temporal-envelope pitch cue that survives is weak and easily masked. The result is that intervals and chords that a normal-hearing listener perceives as consonant or dissonant are largely indistinguishable through the implant.[2008][2008][2009]

TThe musical cocktail-party problem

Segregating a melody line from its accompaniment, or a singer from a backing band, is a musical version of the cocktail-party problem: the listener must group some partials into a foreground stream and reject the rest. Normal hearing uses fine spectral detail, harmonicity and pitch differences to form these streams; the implant delivers little of this information, so foreground and background fuse. Lyrics carry linguistic cues the brain can latch onto, which is why a sung melody with words is often easier to follow than the same melody played on an instrument inside an ensemble. Adding an accompaniment typically lowers melody-recognition scores sharply compared with the same melody presented alone.[2009][2008][2005]

CWhat stays accessible: rhythm and single lines

Rhythm and tempo ride on the temporal envelope, which the implant transmits well, so beat, meter and rhythmic patterns are perceived almost normally and remain a reliable source of musical enjoyment. Simple, single-line (monophonic), rhythmically strong music is the most accessible: a solo voice, a single instrument, a strong drum line, or familiar songs with clear lyrics. Dense orchestral writing, choral harmony, jazz and harmonically rich pop are the least accessible because many pitches and timbres overlap at once. Practical counselling: encourage recipients to start with rhythmic, sparsely arranged, familiar pieces and to use lyrics and visual cues, rather than expecting to enjoy a full orchestra early on.[2008][2008]