Jean-Baptiste Thiebaut, PhD Candidate
Saturday 23 December 2006, by jmc
All the versions of this article:
Jean-Baptiste Thiebaut is Ph.D. candidate at the CICM (Research center Informatique and Musical Creation), Université Paris VIII and in the " Interaction, Media and Communication Research Group ", Queen Mary University, London. Its subject of research at the CICM concerns sound visualisation and reversible interfaces, that successively allows to visualise the sound and to sonify the image. In London, its research concernes the impact of visual devices in the communication between musicians, and between the musicians and the public.
The visualisation of sound is of various interests for musical creation, live, and human-human communication. The principle of reversibility allows new handling of the sound: on the basis of the analysis of the sound (for example with the STFT, short-time Fourier transform) we obtain an image representing the frequencies and the amplitude for a given period. By modifying this image graphically and by applying the opposite process (synthesis), we obtain a new sound, modified by graphic interactions. This principle is a starting point to explore strategies of mapping sound towards the image and of the image towards the sound. One of the mappings developed in the Sonos software is the use of images of transfer to modify the analysed sound. This method makes it possible to use an interaction in real time and the use of videos for the transformation of the sound. The interest of the video is that it can contain great number of data and evolve/move in time. In the case of Sonos, video can be a guide for the composer and for the listener because it contains all the parameters of sound transformation.
On the visualisation of the sound, several prototypes worked out with jitter on a music of Horacio Vaggione, ’ Ash’ are accessible.
Software achievements linked to sound visualisation:
Software Sonos, trajectory, chenillard
Publications:
Jean-Baptiste Thiebaut, "Visualisation du son et réversibilité, l’exemple du logiciel Sonos" CICM - Université Paris VIII MSH Paris Nord, Actes des Journées d’Informatique Musicales 2005 (JIM 05), Saint Denis, France
Jean-Baptiste Thiebaut, "Pompiloop, logiciel de création musicale jeune public" - Université Paris VIII MSH Paris Nord, Actes des Journées d’Informatique Musicales 2005 (JIM 05), Saint Denis, France
Jean-Baptiste Thiebaut, "A graphical interface for trajectory design and musical purposes" - Université Paris VIII MSH Paris Nord, Actes des Journées d’Informatique Musicales 2005 (JIM 05), Saint Denis, France
With Anne Sedes and Benoît Courribet