Spectrograms

From WikiDelia
Revision as of 16:20, 3 February 2016 by Martinwguy (talk | contribs) (Software)
Jump to navigationJump to search

City Music - Spectrogram.jpg

Spectrograms are used in the WikiDelia to visualise the sonic content of Delia's pieces of music.

In each spectrgram, time runs from left to right, low frequencies are at the bottom and high ones at the top and the light at each point in the graph represents the energy in the sound at one frequency at a particular moment (or, rather, in one frequency band around a particular moment.)

As well as helping us understand the internal structure of Delia's pieces and her instruments and effects, these also help us recreate conventional scores from her sound files, for example:

Logarithmic frequency axis

The spectrograms used in the WikiDelia are not the usual kind, where the Y axis represents the linear frequency scale from 0 to 22050Hz and in which the top half of the graphic represents just the top octave of the sound, with all the musical detail crushed into the bottom few pixels. Here, the vertical scale is logarithmic, which gives the same number of pixel rows per semitone and per octave.

Not only does this give a graphic representation to music similar to conventional score notation but also give a visual footprint of the same height and shape to each note of an instrument.

Usage in the WikiDelia

The spectrogram of a piece goes in three places:

  • On the piece's page in a section Spectrogram usually just above Availability so that the Listen button is near.
  • Spectrograms of complete pieces are on the Audio page
  • in delia-derbyshire.net/spectrograms

For example the piece Air has File:Air.ogg and File:Air - Spectrogram.jpg, used by the MediaWiki macros {{Spectrogram|Air - Spectrogram}} and {{Spectrogallery|Air}}

Get spectrograms of your music!

Moogies Bloogies - Spectrogram with piano staff (detail)

I am happy to run the log spectrum analyser on your music. You can specify:

  • lowest pitch (usually 27.5Hz)
  • number of octaves (usually 9, to 14080Hz)
  • number of pixels per semitone on the frequency axis (usually 8)
  • number of pixel columns per second on the time axis (usually 50)

Optionally the software can superimpose single-pixel black and white lines at the frequencies of the piano keys and three-pixel-wide white lines at the positions of the manuscript stave lines, see the example on the right.

If this interests you, please Make a small donation and email delia.derbyshire.net@gmail.com attaching the sound file you would like turned into a picture.

Software

The WikiDelia's spectrum analyser was written specifically for it, using a modified version of sndfile-spectrogram to prepare a linear spectrogram which is then distorted by an ImageMagick script to give it a logarithmic frequency axis.

The program "Sox" can also be used to produce the linear spectrogram, but you need this modified version to remove the limits on output image size, to normalise the output's brightness, and to make it 250 times faster and not need 16GB of RAM.

An alternative technique would be to write a Constant-Q tranform directly instead of distorting a linear FFT [1] [2] [3] [4] [5] but my results with the implementations I have found have so far been disapponting: crisper at the top but completely losing temporal detail in the lower frequency range.

Graphical programs that can directly display log-frequency-axis spectrograms are:

  • the free audio editor Audacity, though the output is blockier than ours
  • the free audio file viewer "sonic-visualiser", which also has a Constant-Q spectrogram VAMP plugin

References

  1. An efficient algorithm for the calculation of a constant Q transform by Brown and Puckette.
  2. The Constant Q Transform, an implementation in Matlab by Benjamin Blankertz
  3. Constant-Q Transform Toolbox for Music Processing: An optimization in MATLAB of Brown and Puckette's efficient Constant-Q algorithm.
  4. C++ Constant-Q at soundsoftware.co.uk, a C++ implementation of the above with permissive license.
  5. An earlier implementation in more C-like C++ in a pitch detection plugin for Supercollider, licensed under GPL.