Eerola, T. and Jakubowski, K. and Moran, N. and Keller, P. and Clayton, M. (2018) 'Shared periodic performer movements coordinate interactions in duo improvisations.', Royal Society open science., 5 (2). p. 171520.
Human interaction involves the exchange of temporally coordinated, multimodal cues. Our work focused on interaction in the visual domain, using music performance as a case for analysis due to its temporally diverse and hierarchical structures. We made use of two improvising duo datasets—(i) performances of a jazz standard with a regular pulse and (ii) non-pulsed, free improvizations—to investigate whether human judgements of moments of interaction between co-performers are influenced by body movement coordination at multiple timescales. Bouts of interaction in the performances were manually annotated by experts and the performers’ movements were quantified using computer vision techniques. The annotated interaction bouts were then predicted using several quantitative movement and audio features. Over 80% of the interaction bouts were successfully predicted by a broadband measure of the energy of the cross-wavelet transform of the co-performers’ movements in non-pulsed duos. A more complex model, with multiple predictors that captured more specific, interacting features of the movements, was needed to explain a significant amount of variance in the pulsed duos. The methods developed here have key implications for future work on measuring visual coordination in musical ensemble performances, and can be easily adapted to other musical contexts, ensemble types and traditions.
|Full text:||(VoR) Version of Record|
Available under License - Creative Commons Attribution.
Download PDF (1391Kb)
|Publisher Web site:||https://doi.org/10.1098/rsos.171520|
|Publisher statement:||© 2018 The Authors. Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/, which permits unrestricted use, provided the original author and source are credited.|
|Date accepted:||16 January 2018|
|Date deposited:||21 February 2018|
|Date of first online publication:||21 February 2018|
|Date first made open access:||21 February 2018|
Save or Share this output
|Look up in GoogleScholar|