Access the full text.
Sign up today, get DeepDyve free for 14 days.
A. Seitz, Robyn Kim, Ladan Shams (2006)
Sound Facilitates Visual LearningCurrent Biology, 16
M. Beauchamp (2005)
See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortexCurrent Opinion in Neurobiology, 15
H. Brock, G. Schmitz, Jan Baumann, A. Effenberg (2012)
If motion sounds: Movement sonification based on inertial sensor dataProcedia Engineering, 34
Matthias Rath, D. Rocchesso (2005)
Continuous sonic feedback from a rolling ballIEEE MultiMedia, 12
(2011)
Psychoacoustics, in: The Sonification Handbook, T
W. Young, M. Rodger, C. Craig (2013)
Perceiving and reenacting spatiotemporal characteristics of walking sounds.Journal of experimental psychology. Human perception and performance, 39 2
A. Bidet-Caulet, Julien Voisin, O. Bertrand, P. Fonlupt (2005)
Listening to a walking human activates the temporal biological motion areaNeuroImage, 28
David González, A. Dubrowski, H. Carnahan (2010)
The use of auditory cues in anticipatory control of grasping forces.Motor control, 14 2
B. Kapralos, Michael Jenkin, E. Milios, B. Kapralos, Michael Jenkin, E. Milios (2002)
Auditory Perception and Spatial Auditory Systems4
L. Carey, D. Abbott, A. Puce, G. Jackson, A. Syngeniotis, G. Donnan (2002)
Reemergence of activation with poststroke somatosensory recovery: A serial fMRI case studyNeurology, 59
Julie Wilson-Bokowiec, Mark Bokowiec (2006)
Kinaesonics: The intertwining relationship of body and soundContemporary Music Review, 25
L. Lemura (1998)
The Biophysical Foundations of Human MovementMedicine and Science in Sports and Exercise, 30
(2011)
Psychoacoustics, in: The Sonification Handbook
(2013)
Multisensory Research
N.Y. Acad. Sci
A. Lahav, E. Saltzman, G. Schlaug (2007)
Action Representation of Sound: Audiomotor Recognition Network While Listening to Newly Acquired ActionsThe Journal of Neuroscience, 27
G. Schmitz, B. Mohammadi, A. Hammer, M. Heldmann, A. Samii, T. Münte, A. Effenberg (2013)
Observation of sonified movements engages a basal ganglia frontocortical networkBMC Neuroscience, 14
T. Arendt, V. Bigl, A. Tennstedt, A. Arendt (1985)
Neuronal loss in different parts of the nucleus basalis is related to neuritic plaque formation in cortical target areas in alzheimer's diseaseNeuroscience, 14
G. Johansson (1973)
Visual perception of biological motion and a model for its analysisPerception & Psychophysics, 14
G. Schmitz, A. Effenberg (2012)
PERCEPTUAL EFFECTS OF AUDITORY INFORMATION ABOUT OWN AND OTHER MOVEMENTS
A. Kibele (2006)
Non-consciously controlled decision making for fast motor reactions in sports—A priming approach for motor responses to non-consciously perceived movement featuresPsychology of Sport and Exercise, 7
G. Calvert, C. Spence, B. Stein (2004)
The Handbook of Multisensory Processing
G. Rizzolatti (2005)
The mirror neuron system and its function in humansAnatomy and Embryology, 210
Katharina Vogt, D. Pirrò, Ingo Kobenz, Robert Höldrich, G. Eckel (2009)
PhysioSonic - Evaluated Movement Sonification as Auditory Feedback in Physiotherapy
A. Effenberg (2005)
Movement sonification: Effects on perception and actionIEEE MultiMedia, 12
S. Ringenbach, A. Gemmert, H. Shill, G. Stelmach (2011)
Auditory instructional cues benefit unimanual and bimanual drawing in Parkinson's disease patients.Human movement science, 30 4
G. Croix, L. Lejeune, David Anderson, R. Thouvarecq (2010)
Light fingertip contact on thigh facilitates handstand balance in gymnastsPsychology of Sport and Exercise, 11
Ladan Shams, A. Seitz (2008)
Benefits of multisensory learningTrends in Cognitive Sciences, 12
L. Scheef, H. Boecker, M. Daamen, U. Fehse, Maarten Landsberg, D. Granath, H. Mechling, A. Effenberg (2009)
Multimodal motion processing in area V5/MT: Evidence from an artificial class of audio-visual eventsBrain Research, 1252
R. Schmidt, Timothy Lee (1982)
Motor Control and Learning: A Behavioral Emphasis
A. Williams, P. Ward, N. Smeeton (2004)
Perceptual and cognitive expertise in sport : implications for skill acquisition and performance enhancement
C. Parise, C. Spence, M. Ernst (2012)
When Correlation Implies Causation in Multisensory IntegrationCurrent Biology, 22
Thomas Helten, H. Brock, Meinard Müller, H. Seidel (2011)
Classification of trampoline jumps using inertial sensorsSports Engineering, 14
R. Oldfield (1971)
The assessment and analysis of handedness: the Edinburgh inventory.Neuropsychologia, 9 1
D. Fong, Y. Chan (2010)
The Use of Wearable Inertial Motion Sensors in Human Lower Limb Biomechanics Studies: A Systematic ReviewSensors (Basel, Switzerland), 10
E. Làdavas (2008)
Multisensory‐based Approach to the Recovery of Unisensory DeficitAnnals of the New York Academy of Sciences, 1124
Ian Thorntonô, Ronald Rensink, M. Shiffrar (2002)
Active versus passive processing of biological motionPerception, 31
P. Lachenbruch (1989)
Statistical Power Analysis for the Behavioral Sciences (2nd ed.)Journal of the American Statistical Association, 84
SidneyA Simon (2008)
Merging of the SensesFrontiers in Neuroscience, 2
Although visual perception is dominant on motor perception, control and learning, auditory information can enhance and modulate perceptual as well as motor processes in a multifaceted manner. During last decades new methods of auditory augmentation had been developed with movement sonification as one of the most recent approaches expanding auditory movement information also to usually mute phases of movement. Despite general evidence on the effectiveness of movement sonification in different fields of applied research there is nearly no empirical proof on how sonification of gross motor human movement should be configured to achieve information rich sound sequences. Such lack of empirical proof is given for (a) the selection of suitable movement features as well as for (b) effective kinetic–acoustical mapping patterns and for (c) the number of regarded dimensions of sonification. In this study we explore the informational content of artificial acoustical kinematics in terms of a kinematic movement sonification using an intermodal discrimination paradigm. In a repeated measure design we analysed discrimination rates of six everyday upper limb actions to evaluate the effectiveness of seven different kinds of kinematic–acoustical mappings as well as short term learning effects. The kinematics of the upper limb actions were calculated based on inertial motion sensor data and transformed into seven different sonifications. Sound sequences were randomly presented to participants and discrimination rates as well as confidence of choice were analysed. Data indicate an instantaneous comprehensibility of the artificial movement acoustics as well as short term learning effects. No differences between different dimensional encodings became evident thus indicating a high efficiency for intermodal pattern discrimination for the acoustically coded velocity distribution of the actions. Taken together movement information related to continuous kinematic parameters can be transformed into the auditory domain. Additionally, pattern based action discrimination is obviously not restricted to the visual modality. Artificial acoustical kinematics might be used to supplement and/or substitute visual motion perception in sports and motor rehabilitation.
Multisensory Research (continuation of Seeing & Perceiving from 2013) – Brill
Published: Jan 1, 2013
Keywords: Acoustical kinematics; auditory movement information; kinematic–acoustical mapping; motor learning; movement sonification; multisensory integration; perceptual learning
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.