On quantifying multisensory interaction effects in reaction time and detection rateRach, Stefan; Diederich, Adele; Colonius, Hans
doi: 10.1007/s00426-010-0289-0pmid: 20512352
Both mean reaction time (RT) and detection rate (DR) are important measures for assessing the amount of multisensory interaction occurring in crossmodal experiments, but they are often applied separately. Here we demonstrate that measuring multisensory performance using either RT or DR alone misses out on important information. We suggest an integration of RT and DR into a single measure of multisensory performance: the first index (MRE*) is based on an arithmetic combination of RT and DR, the second (MPE) is constructed from parameters derived from fitting a sequential sampling model to RT and DR data simultaneously. Our approach is illustrated by data from two audio–visual experiments. In the first, a redundant targets detection experiment using stimuli of different intensity, both measures yield similar pattern of results supporting the “principle of inverse effectiveness”. The second experiment, introducing stimulus onset asynchrony and differing instructions (focused attention vs. redundant targets task) further supports the usefulness of both indices. Statistical properties of both measures are investigated via bootstrapping procedures.
Decomposing rhythm processing: electroencephalography of perceived and self-imposed rhythmic patternsSchaefer, Rebecca; Vlek, Rutger; Desain, Peter
doi: 10.1007/s00426-010-0293-4pmid: 20574661
Perceiving musical rhythms can be considered a process of attentional chunking over time, driven by accent patterns. A rhythmic structure can also be generated internally, by placing a subjective accent pattern on an isochronous stimulus train. Here, we investigate the event-related potential (ERP) signature of actual and subjective accents, thus disentangling low-level perceptual processes from the cognitive aspects of rhythm processing. The results show differences between accented and unaccented events, but also show that different types of unaccented events can be distinguished, revealing additional structure within the rhythmic pattern. This structure is further investigated by decomposing the ERP into subcomponents, using principal component analysis. In this way, the processes that are common for perceiving a pattern and self-generating it are isolated, and can be visualized for the tasks separately. The results suggest that top-down processes have a substantial role in the cerebral mechanisms of rhythm processing, independent of an externally presented stimulus.
Learning expressive percussion performance under different visual feedback conditionsBrandmeyer, Alex; Timmers, Renee; Sadakata, Makiko; Desain, Peter
doi: 10.1007/s00426-010-0291-6pmid: 20574662
A study was conducted to test the effect of two different forms of real-time visual feedback on expressive percussion performance. Conservatory percussion students performed imitations of recorded teacher performances while receiving either high-level feedback on the expressive style of their performances, low-level feedback on the timing and dynamics of the performed notes, or no feedback. The high-level feedback was based on a Bayesian analysis of the performances, while the low-level feedback was based on the raw participant timing and dynamics data. Results indicated that neither form of feedback led to significantly smaller timing and dynamics errors. However, high-level feedback did lead to a higher proficiency in imitating the expressive style of the target performances, as indicated by a probabilistic measure of expressive style. We conclude that, while potentially disruptive to timing processes involved in music performance due to extraneous cognitive load, high-level visual feedback can improve participant imitations of expressive performance features.
Implicit chord processing and motor representation in pianistsTrimarchi, Pietro; Luzzatti, Claudio
doi: 10.1007/s00426-010-0292-5pmid: 20556421
The aim of this paper is to assess the relevance of pitch dimension in auditory–motor interaction. Several behavioural and brain imaging studies have shown that auditory processing of sounds can activate motor representations, an effect which is however elicited only by action-related sounds, i.e., sounds linked to a specific motor repertoire. Music provides an appropriate framework for further exploration of this issue. Three groups of participants (pianists, non-pianist musicians and non-musicians) were tested with a shape decision task where left-hand and right-hand responses were required; each visual stimulus was paired with an auditory task-irrelevant stimulus (high-pitched or low-pitched piano-timbre chords). Of the three groups, only pianists had longer reaction times for left-hand/high-pitched chords and right-hand/low-pitched chords associations. These findings are consistent with an auditory-motor effect elicited by pitch dimension, as only pianists show an interaction between motor responses and implicit pitch processing. This interaction is consistent with the canonical mapping of hand gestures and pitch dimension on the piano keyboard. The results are discussed within the ideo-motor theoretical framework offered by the Theory of Event Coding (Hommel et al. in Behav Brain Sci 24:849–937, 2001).
Implementation of structure-mapping inference by event-file binding and action planning: a model of tool-improvisation analogiesFields, Chris
doi: 10.1007/s00426-010-0290-7pmid: 20526615
Structure-mapping inferences are generally regarded as dependent upon relational concepts that are understood and expressible in language by subjects capable of analogical reasoning. However, tool-improvisation inferences are executed by members of a variety of non-human primate and other species. Tool improvisation requires correctly inferring the motion and force-transfer affordances of an object; hence tool improvisation requires structure mapping driven by relational properties. Observational and experimental evidence can be interpreted to indicate that structure-mapping analogies in tool improvisation are implemented by multi-step manipulation of event files by binding and action-planning mechanisms that act in a language-independent manner. A functional model of language-independent event-file manipulations that implement structure mapping in the tool-improvisation domain is developed. This model provides a mechanism by which motion and force representations commonly employed in tool-improvisation structure mappings may be sufficiently reinforced to be available to inwardly directed attention and hence conceptualization. Predictions and potential experimental tests of this model are outlined.
How the social-evaluative context modulates processes of cognitive controlDreisbach, Gesine; Böttcher, Svenja
doi: 10.1007/s00426-010-0298-zpmid: 20607282
Cognitive control enables intelligent systems to select relevant information in the face of distracting information. The aim of the research presented here was to investigate the influence of the social-evaluative context on processes of cognitive control. Female participants had to perform the Erikson flanker task with each trial being preceded by a photograph of an attractive woman or a beautiful landscape. Concurrently, another person (partner or fellow student) either evaluated the attractiveness of the pictures of the women or the beauty of the landscapes. Participants showed increased flanker interference on trials following the presentation of pictures of attractive women, but only, if these were concurrently evaluated by another person. By contrast, in the control conditions (social presence without concurrent picture evaluation, or picture evaluation without social presence) no such effect occurred. That is, the concurrent evaluation task selectively increased distractibility presumably due to the affective reaction to the social-evaluative context.
Does motor interference arise from mirror system activation? The effect of prior visuo-motor practice on automatic imitationCapa, Rémi; Marshall, Peter; Shipley, Thomas; Salesse, Robin; Bouquet, Cédric
doi: 10.1007/s00426-010-0303-6pmid: 20668875
Action perception may involve a mirror-matching system, such that observed actions are mapped onto the observer’s own motor representations. The strength of such mirror system activation should depend on an individual’s experience with the observed action. The motor interference effect, where an observed action interferes with a concurrently executed incongruent action, is thought to arise from mirror system activation. However, this view was recently challenged. If motor interference arises from mirror system activation, this effect should be sensitive to prior sensorimotor experience with the observed action. To test this prediction, we measured motor interference in two groups of participants observing the same incongruent movements. One group had received brief visuo-motor practice with the observed incongruent action, but not the other group. Action observation induced a larger motor interference in participants who had practiced the observed action. This result thus supports a mirror system account of motor interference.