A survey of sensor use in digital musical instruments

Participants: Mark T. Marshall
Marcelo M. Wanderley
Funding: EU Cost287 intiative ConGAS: Gesture Controlled Audio Systems
Project Type:

Time Period: (Completed.)

Project Description

The aim of this project was to gain an overview of the digital musical instruments which have been designed and built in recent times. This task consisted of two survey tasks. The first was to examine a large number of digital musical instruments and classify the instruments themselves into specific categories. The second task was to examine which sensors were being used in each instrument and determine the most commonly used sensors for further research into the use of sensors in digital musical instruments.

Scope of the survey

The first step in the survey involved determining where to find the information related to the instruments in order to be able to classify the instrument and determine which sensors were used in it. It was decided to use the instruments which had been presented at a major conference on the design on digital musical interfaces as the basis of the survey. Therefor we used the instruments presented at the New Interfaces for Musical Expression (NIME) conferences from 2000 to 2004 as the basis of this work. This resulted in a total of over 130 instruments and interfaces being surveyed.

Instrument classification

The instruments found in the papers and posters from the NIME conferences were classified using a simple classification scheme. The scheme divided the instruments into the following categories:

  • Collaborative instruments: instruments played by more than one person simultaneously
  • Augmented instruments: traditional instruments augmented with sensor technology
  • Instrument-like instruments: new instruments strongly based on traditional instruments
  • Instrument-inspired instruments: new instruments inspired by, but not based on, traditional instruments
  • Alternative instruments: new instruments which are not based on any traditional instrument

The results of this survey are shown in the following table and graph:

NIME'01 NIME'02 NIME'03 NIME'04 Total
Alternate Instruments 21 22 25 16 84
Instrument-inspired 0 3 4 3 10
Instrument-like 2 2 1 3 8
Augmented instruments 3 3 7 3 16
Collaborative Instruments 0 7 2 7 16
Total 26 37 39 32 134

Sensor usage

The sensors used in each of these instruments was also determined and ranked by the popularity of the sensor. It should be noted that as only sensors were being surveyed, devices such as joysticks and video cameras are not included. The following table shows the sensors found, in order of popularity:

Accelerometer 18
FSR 14
Infrared sensor 9
Light sensor 8
Touch pad 8
Bend sensor 6
Capacitive sensor 6
Graphics tablet 6
Rotary potentiometer 6
Gyroscope 5
Linear potentiometer 5
Pressure sensor 5
Air pressure 4
Magnetic 3
Slide sensor 3
Strain gauge 3
Proximity sensor 2
Tilt sensor 2
Temperature sensor 1
Ultrasound sensor 1