Strategies for Continuous Auditory Display of Arousal and Valence
| Participants: |
R. Michael Winters Marcelo M. Wanderley (supervisor) |
|
|---|---|---|
| Funding: | NSERC | |
| Project Type: | Masters Thesis | |
| Time Period: | April 2012–April 2014 (Completed.) |
Project Description
Sound is capable of profound emotional experiences: one need look no further than the importance of music in film. Sonification is field of research interested in the use of sound to convey information in general, but what happens when the data is emotion? To objectively and systematically convey this data, I have explored sources of auditory-emotion induction in environmental sound and music. Choosing wisely from these sources, emotion can be communicated when social displays of affect are unavailable, misleading, or inappropriate. In my thesis, I developed sonification strategies based upon select structural/acoustic features and auditory-cognitive mechanisms. I produced the first ever computational evaluation of a sonification of emotion, using a publicly available tool for music emotion recognition. The evaluation highlights benefits and limitations of computational design, a technique that in addition to practical applications, can be used to acoustically instantiate mathematical models of musical emotion.
News
- Organised Sound Paper Accepted 2013/10/20
- MIREmotion Visualizer Released on GitHub 2013/05/08
Related Work
This project was inspired by a six-month NSERC Engage Grant:
Thesis WordCloud
Talks and Publications
- R. Michael Winters and Marcelo M. Wanderley. “Sonification of Emotion: Strategies and Results from the Intersection with Music,” Organised Sound, 19(1), 2014.
- R. Michael Winters and Marcelo M. Wanderley. “Sonification of Emotion: Strategies for Continuous Auditory Display of Arousal and Valence,” International Conference on Music and Emotion, Jyväskylä, Finland, June 10-15, 2013.
- R. Michael Winters, Ian Hattwick, and Marcelo M. Wanderley. “Integrating Emotional Data into Music Performance: Two Audio Environments for the Emotional Imaging Composer,” The International Conference on Music and Emotion, Jyväskylä, Finland, June 10-15, 2013.
More Information
Thesis Proposal, Accepted January 2013.