This is an old revision of the document!
| Participants: |
Alexandre Bouënard (Université de Bretagne Sud/McGill University) Sylvie Gibet (supervisor, Université de Bretagne Sud) Marcelo M. Wanderley (supervisor, McGill University) Fabrice Marandola (McGill University) |
|
|---|---|---|
| Funding: |
Valoria-SAMSARA, Université de Bretagne Sud, Pôle de Compétitivité Images & Réseaux NSERC Discovery Grant (M. Wanderley) International Doctoral College of the Université Européenne de Bretagne (UEB) (A. Bouënard) |
|
| Project Type: |
Doctoral thesis (2006-2009), Postdoctoral fellowship (2010). |
|
| Time Period: | Sept. 2006–Aug. 2010. (Completed.) |
Project Description
This project focuses on the interaction of autonomous, realistic and musically-gifted virtual agents with sound synthesis systems.
Our interest lies both in the analysis and the synthesis of percussive gestures. One the one hand, the analysis focuses on timpani gestures and aims at extracting relevant movement features. On the other hand, the synthesis part involves an inverse-dynamics control chain of a mechanical virtual agent model. For improved realism, we will use physical modelling for sound synthesis.
We expect that the virtual agent simulation will show the relevance of gestural control in animation, since gesture influence acts on the fine nature of the produced sound and on the spatial and temporal coordination of movements in charge of musical expressivity.
Publications
- Alexandre Bouënard, Sylvie Gibet and Marcelo M. Wanderley. “Hybrid Inverse Motion Control for Virtual Characters Interacting with Sound Synthesis - Application to Percussion Motion.” Accepted for Publication in The Visual Computer journal.
- Alexandre Bouënard, Marcelo M. Wanderley, Sylvie Gibet and Fabrice Marandola. “Virtual Gesture Control and Synthesis of Music Performances: Qualitative Evaluation of Synthesized Timpani Exercises”. Computer Music Journal, 35(3), Fall 2011. (In Press).
- Florian Grond, Alexandre Bouënard, Thomas Hermann and Marcelo M. Wanderley. “Virtual Auditory Myography of Timpani-playing Avatars”. In Proceedings of the International Conference on Digital Audio Effects (DAFX), Graz, Austria, 2010.
- Alexandre Bouënard, Marcelo M. Wanderley and Sylvie Gibet. “Gesture Control of Sound Synthesis: Analysis and Classification of Percussion Gestures”. Acta Acustica united with Acustica, Special issue on Natural and Virtual Instruments: Control, Gesture and Player Interaction, 96(4):668-677, 2010.
- Alexandre Bouënard. “Synthesis of Music Performances: Virtual Character Animation as a Controller of Sound Synthesis”, Ph.D. thesis, European University of Brittany. Defended on December 10, 2009. Co-supervisors: Sylvie Gibet (UBS, France) and Marcelo M. Wanderley
- Alexandre Bouënard, Marcelo M. Wanderley and Sylvie Gibet. "Advantages and Limitations of Simulating Percussion Gestures for Sound Synthesis." In Proceedings of the International Computer Music Conference (ICMC), pp. 255-261, Montreal, Qc., Canada, 2009.
- Alexandre Bouënard, Sylvie Gibet and Marcelo M. Wanderley. "Hybrid Motion Control combining Inverse Kinematics and Inverse Dynamics Controllers for Simulating Percussion Gestures." In Proceedings of the International Conference on Computer Animation and Social Agents (CASA), pp. 17-20, Amsterdam, the Netherlands, 2009.
- Alexandre Bouënard, Marcelo M. Wanderley and Sylvie Gibet. "Analysis of Timpani Preparatory Gesture Parameterization." In Proceedings of the International Gesture Workshop (GW), Bielefeld, Germany, pp. 61-62, 2009.
- Alexandre Bouënard, Sylvie Gibet and Marcelo M. Wanderley. "Real-Time Simulation and Interaction of Percussion Gestures with Sound Synthesis". Technical Report, HAL Open Archives, January 2009.
- Alexandre Bouënard, Marcelo M. Wanderley and Sylvie Gibet. “Analysis of Percussion Grip for Physically Based Character Animation.” In Proceedings of the 5th International Conference on Enactive Interfaces (ENACTIVE), Pisa, Italy, pp. 22-27, 2008.
- Alexandre Bouënard, Sylvie Gibet and Marcelo M. Wanderley. “Enhancing the Visualization of Percussion Gestures by Virtual Character Animation.” In Proceedings of the 2008 International Conference on New Interfaces for Musical Expression (NIME), Genoa, Italy, pp. 38-43, 2008.
- Sylvie Gibet and Alexandre Bouënard. “Sound Synthesis by Simulation of Percussive Gesture of a Virtual Animated Agent.” In 2nd ConGAS International Symposium on Gesture Interfaces for Multimedia Systems (GIMS) Leeds, UK, May 2006.