~~NOTOC~~

====== Strategies for Continuous Auditory Display of Arousal and Valence ======
{{template>projects:summary
|title=Strategies for Continuous Auditory Display of Arousal and Valence|
|participants=[[people: R. Michael Winters]]\\
 [[people:Marcelo M. Wanderley]] (supervisor)|
|funding=NSERC|
|type=Masters Thesis|
|period=April 2012--April 2014|
|status=Completed.|
|image=projects:sonification:av.png
|caption=GUI as of January 25, 2013.
}}

===== Project Description =====

Sound is capable of profound emotional experiences: one need look no further than the importance of music in film.  Sonification is field of research interested in the use of sound to convey information in general, but what happens when the data is emotion?
To objectively and systematically convey this data, I have explored sources of auditory-emotion induction in environmental sound and music.  Choosing wisely from these sources, emotion can be communicated when social displays of affect are unavailable, misleading, or inappropriate.  In my thesis, I developed sonification strategies based upon select structural/acoustic features and auditory-cognitive mechanisms.  I produced the first ever computational evaluation of a sonification of emotion, using a publicly available tool for music emotion recognition.  The evaluation highlights benefits and limitations of computational design, a technique that in addition to practical applications, can be used to acoustically instantiate mathematical models of musical emotion.


===== News =====

  *[[news:sonification_of_emotion_research_to_appear_in_organized_sound|Organised Sound Paper Accepted]] 2013/10/20
  *[[news:idmil_in_jyvaeskylae|Two Papers Presented at ICME2013 in Jyväskylä]] 2013/06/12
  *[[news:miremotion-visualizer|MIREmotion Visualizer Released on GitHub]] 2013/05/08   

===== Related Work =====

This project was inspired by a six-month [[projects:software:eic_audio|NSERC Engage Grant]]:

{{vimeo>53756746?680x400}}

===== Thesis WordCloud =====

{{projects:sonification:thesiswordcloud.png?680}}

----
===== Talks and Publications =====

  * [[people:R. Michael Winters]] and [[people:Marcelo M. Wanderley]]. "{{publications:wintersos.pdf|Sonification of Emotion: Strategies and Results from the Intersection with Music}}," //Organised Sound,// 19(1), 2014.
  * [[people:R. Michael Winters]] and [[people:Marcelo M. Wanderley]]. "[[https://jyx.jyu.fi/dspace/bitstream/handle/123456789/41619/R.%20Michael%20Winters%20-%20Sonification%20of%20Emotion%20-%20Strategies%20for%20Continuous%20Display%20of%20Arousal%20and%20Valence.pdf?sequence=1|Sonification of Emotion: Strategies for Continuous Auditory Display of Arousal and Valence]]," //International Conference on Music and Emotion//, Jyväskylä, Finland, June 10-15, 2013.
  * [[people:R. Michael Winters]], [[people:Ian Hattwick]], and [[people:Marcelo M. Wanderley]]. "[[https://jyx.jyu.fi/dspace/bitstream/handle/123456789/41617/R.%20Michael%20Winters%20-%20Emotional%20Data%20in%20Music%20Performance%20-%20Two%20Audio%20Environments%20for%20the%20Emotional%20Imaging%20Composer.pdf?sequence=1|Integrating Emotional Data into Music Performance: Two Audio Environments for the Emotional Imaging Composer]]," //The International Conference on Music and Emotion//, Jyväskylä, Finland, June 10-15, 2013.
  * [[people:R. Michael Winters]], "{{projects:sonification:sonmusemo.pdf|Sonification, Emotion, and Music: Strategies for Continuous Auditory Display of Arousal and Valence}}," //[[http://www.cirmmt.mcgill.ca/activities/student-colloquia/music-perception-cognition/201202|CIRMMT Music Perception and Cognition Colloquium]],// Jan. 24, 2013. {{projects:sonification:sonmusemo.pdf|PDF}}
  * [[people:R. Michael Winters]] and [[people:Ian Hattwick]], "{{projects:sonification:cirmmtpresentationeic.pdf|Audio Environment for the Emotional Imaging Composer}}," //[[http://www.cirmmt.mcgill.ca/activities/seminars/idmil|NSERC/CIRMMT Engage Grant Demos]],// Sep. 26, 2012.

----
===== More Information =====

{{projects:sonification:proposal.pdf|Thesis Proposal}}, Accepted January 2013.


{{tag>Sonification Mapping Affect Emotion}}