The Basic Building Blocks of Music Synthesis

[ ]
April 20, 2018

This is a short writeup of the things I learned regarding music synthesis while browsing Berklee Music - Creating Sounds for Electronic Music

1. Oscillators (VCOs)

These are the sources of sound, also called VCOs (voltage-controlled oscillators). The oscillators generate sound based on pre-defined waveforms.

Quite often the pitch can be modulated. For example, by pressing different keys on a keypad.

Qualities of Different Waveforms

Square wave: Sounds hallow compared to sawtooth waves (because it’s missing the even harmonics in the frequency spectrum) Sawtooth wave: sounds bright, harsh and full (because it contains all the harmonics).

Relation Between a WaveForm and How A Sound Is Generated

The waveform is actually related to how a sound is initially created.

For example, clarinet sound can be synthesized from square waves because it’s played through a reed, which opens up and closes down very quickly.

Another example is to synthesize string sounds. We’ll started with sawtooth waves because strings are usually played using a bow and it pulls against the string until the tension on the string is strong enough so that it snaps back (“slip and stick” motion).

2. Filters (VCFs)

Low-pass filters are probably the most important types of filters because many types of oscillators generates high-frequency harmonics that can sound very harsh.

Since the filters operate on the frequency spectrum, we can use them to change the timbre of the sound from bright/harsh to dull.

The most useful thing to remember is: If you use a patch and it’s too bright/dull, try to change the cutoff frequency knob.

Due to the existence of the resonance, filters can actually boost signals in certain frequency and the “sound” of filters plays an important role in synthesizer. However, it doesn’t mean that you have to emphasize certain frequencies for all patches. A lot of them work fine without it.

It’s also possible to modulate (i.e. changes it over time) the cutoff frequency by LFOs or other envelopes.

3. LFOs (Low-frequency oscillators)

It’s a type of modulator designed to control another parameter within a synthesizer.

The “low” in LFO means that the frequency is below the range of human hearing (<20Hz). However, you can still select different types of waveforms, just like in an oscillator.

The 3 critical aspects for a modulation:

  1. The source of modulation. For example, in this case a LFO.
  2. The destination of modulation. For example, frequency of an oscillator.
  3. The amount of modulation.

Quite often, this is in a form of matrix to convey the 3 pieces of information above (sometimes it can even be just hard-wired).

Note that the relationship between a modulation source and a destination does not need to be 1-1. For example, one LFO might control multiple destinations with different amount of modulation.

4. Amplifiers

There’s always a specific modulator, envelope, attached to an amplifier.

This envelope runs every time a key is pressed, from left to right.

4 most common controls: “ADSR”, namely, “Attack time”, “Decay time”, “Sustain level” and “Release time”.

  • In synthesizers, high attack time actually translates to a sound taking longer to be audible.
  • The attack in the diagram above is linear. However, there might be other types. For example, attack might increase exponentially. This is true for release/decay.

How ADSR is best Used To Synthesize Sounds

  1. Envelope with sustain level configured. This is good for emulating instruments like strings or brass. Basically, things that can hold the note or add more energy as the note is held.
    1. More specifically, it’s common to see a sustaining envelope with a strong attack. This is applicable to instruments like a trumpet, where a large burst of initial energy, then it dwindles down to a sustain level.
  2. If the sound is generated by a pluck or hit, then sustain level should be 0 and decay time can be used to control the length of a note.

References

  1. Berklee Music - Introduction to Music Production

All Tags