Journal Pbio 2001379
Journal Pbio 2001379
a1111111111
a1111111111
a1111111111 Abstract
a1111111111
a1111111111 This work examined the mechanisms underlying auditory motion processing in the auditory
cortex of awake monkeys using functional magnetic resonance imaging (fMRI). We tested
to what extent auditory motion analysis can be explained by the linear combination of static
spatial mechanisms, spectrotemporal processes, and their interaction. We found that the
OPEN ACCESS
posterior auditory cortex, including A1 and the surrounding caudal belt and parabelt, is
involved in auditory motion analysis. Static spatial and spectrotemporal processes were
Citation: Poirier C, Baumann S, Dheerendra P, Joly
O, Hunter D, Balezeau F, et al. (2017) Auditory able to fully explain motion-induced activation in most parts of the auditory cortex, including
motion-specific mechanisms in the primate brain. A1, but not in circumscribed regions of the posterior belt and parabelt cortex. We show that
PLoS Biol 15(5): e2001379. [Link] in these regions motion-specific processes contribute to the activation, providing the first
10.1371/[Link].2001379
demonstration that auditory motion is not simply deduced from changes in static spatial
Academic Editor: Anthony Zador, Cold Spring location. These results demonstrate that parallel mechanisms for motion and static spatial
Harbor Laboratory, United States of America
analysis coexist within the auditory dorsal stream.
Received: October 19, 2016
Results
We employed virtual auditory motion stimuli smoothly moving in azimuth at a speed of 100˚/s
and different control stimuli (Fig 1A). The choice of the movement plane and the speed of the
motion stimuli were chosen to be ecologically relevant (consistent with everyday listening expe-
rience) and to take advantage of the fact that human and macaque listeners are more accurate
in perceiving angular sound position change in the azimuthal plane than in the vertical one
[17,26,27].
Fig 1. Stimuli and experimental paradigm. (A) Representation of different exemplars of the auditory stimuli used in experiments 1 to 4.
The plots represent the waveform of one moving stimulus, one stationary control stimulus, and one spectrotemporal stimulus. The
pictograms represent the location of each stimulus relative to the subject’s head, as perceived during the experiments. L: left, R: right. (B)
Schematic representation of the main experimental paradigm. We used a sparse-sampling paradigm where 4.9 s-long auditory stimuli
were presented between each scan acquisition (every 10 s). The presentation order of the stimuli was pseudorandomized. Stimuli
illustrated: L40: stationary stimulus coming from the −40˚ position; Mov R1: moving stimulus moving within the right hemispace, starting
from the 0˚ position; R80: stationary stimulus coming from the +80˚ position; Mov L2: moving stimulus moving within the left hemispace,
starting from the −80˚ position; and Mov R2: moving stimulus moving within the right hemispace, starting from the +80˚ position.
[Link]
respectively (the minus sign referring to the left hemispace and the plus sign to the right one).
Because moving stimuli starting from the central position induced similar BOLD responses as
those starting to move from the periphery, data were pooled, resulting in two motion condi-
tions corresponding to sounds moving within the left hemispace (Motion Left) and those mov-
ing within the right hemispace (Motion Right).
The goal of this experiment was to identify the neural substrates of motion perception that
were not explained by the processing of stationary sounds. We thus compared the BOLD
response induced by moving sounds within each hemispace with the average BOLD response
induced by the stationary stimuli corresponding to the spatial positions through which the
moving sounds passed: the BOLD responses induced by stationary stimuli −80˚, −40˚, and 0˚
were thus averaged and compared to those induced by sounds moving in the left hemispace
(contrast Motion Left minus Stationary Left), while the BOLD responses induced by stationary
stimuli +80˚, +40˚, and 0˚ were averaged and compared to those induced by sounds moving in
the right hemispace (contrast Motion Right minus Stationary Right). These comparisons
allowed us to control for the laterality of the motion stimuli (nondynamic spatial information,
corresponding to the encoding of space within which the motion stimulus was moving), as
well as for their intrinsic spectrotemporal content (amplitude-modulated broadband noise fil-
tered through the pinna).
In each subject (monkey 1, M1; monkey 2, M2), the contrasts Motion Left minus Stationary
Left and Motion Right minus Stationary Right revealed widespread activation of the posterior
part of the auditory cortex contralateral to the stimuli, on the superior temporal gyrus (STG)
(Fig 2A and 2B). The activation included the three stages of the hierarchically organized audi-
tory cortex, namely the core (in A1), the belt (in the middle lateral [ML] and CL areas, sur-
rounding A1), and the parabelt (the caudal part of the parabelt, lateral to CL and ML, on the
STG convexity), and extended into the inferior bank of the STG (also known as the superior
bank of the superior temporal sulcus). Activation in the ipsilateral hemisphere was much more
limited (M1) or absent altogether (M2). These results indicate that motion-induced activity in
the contralateral posterior auditory cortex cannot simply be explained by a spatial laterality
process or by encoding of the intrinsic spectrotemporal content of the moving stimuli since
these processes were controlled for by the stationary stimuli.
While in Experiment 1 the BOLD response induced by each stimulus was measured 5 s
after the stimulus onset (targeting the peak of the hemodynamic response function [28]), in a
second experiment we measured the time course of the hemodynamic response induced by
each stimulus, recording the BOLD response 2, 3, 4, and 5 s after the stimulus onset (Fig 2C).
This was to eliminate the possibility that the greater activation triggered by motion stimuli in
Experiment 1 was due to adaptation of the BOLD response to the stationary stimulus while the
motion-induced response was still sustained at its maximal level. This experiment revealed no
interaction between the two stimulus conditions and the four time points tested, except in a
small cluster in the right inferior bank of the STG, where stationary sounds did not induce any
significant activation. This confirms that the contrast between moving and stationary stimuli
revealed in Experiment 1 was not due to a different time course of the BOLD response to the
two types of stimuli.
Fig 2. Motion minus Stationary contrast. (A) Location of the superior temporal gyrus (STG) surface and of the auditory areas in context. The dashed line
corresponds to a cut through the operculum to expose the superior bank of the STG (in black). The relative positions of the primary core area, A1, and the
secondary belts areas, middle lateral (ML) and caudolateral (CL), are indicated on the STG surface. The two straight lines represent the low-frequency (Lf)
and high-frequency (Hf) reversals of tonotopy gradients. L; lateral; C: caudal. See also Materials and Methods and S1 Fig. (B) Motion minus Stationary
contrasts (Experiment 1). Blood-oxygen-level-dependent (BOLD) responses were measured 5 s after the stimulus onset. Significant statistical parametric t
maps are shown on a surface rendering of the STG of each individual (number of scans [n] = 2,466 [monkey 1, M1] and 3,429 [monkey 2, M2]; degrees of
freedom [df] = 2,210 [M1] and 3,071 [M2]; p-values range after correction with the family-wise error (FWE) method [PFWE] from 0.05 to below 1x 10−10 [M1
and M2]). Since activation in the hemisphere ipsilateral to the stimuli was weak or absent, only contralateral activation is shown: Motion Left minus Stationary
Left is projected on the right STG, while Motion Right minus Stationary Right is projected on the left STG. Three different views of each STG are represented:
a top, a lateral, and a bottom view allowing the visualization of the superior bank (Sup.), the convexity (Conv.), and the inferior bank (Inf.) of the STG,
respectively. The transparent region within the black boundary corresponds to motion-responsive regions (defined by the contrasts Motion Left minus
Silence and Motion Right minus Silence, PFWE < 0.05) where the BOLD responses induced by motion and stationary stimuli were not significantly different.
The numbers 1, 2, 3 and 4 indicate the locations where the plots illustrated in panel C are extracted from. (C) Hemodynamic response functions for motion
and stationary stimuli in M1 (Experiment 2). The BOLD response (expressed by the response estimate coefficient, betas) was measured 2, 3, 4, and 5 s after
the stimulus onset. The plots illustrate data from four representative individual voxels whose locations are indicated in panel B. ANOVA tests: n = 5,794,
df = 4,905, F-values below 2.1, and all PFWE = 1. Error bars correspond to standard errors. Data are available from the Open Science Framework ([Link]
io/ut5pa/).
[Link]
Fig 3. Motion minus Spectrotemporal control contrast (Experiment 3). Significant statistical parametric t maps are shown on a surface rendering of
the superior temporal gyrus (STG) contralateral to the stimuli (no activation in the ipsilateral hemisphere): Motion Left minus Spectrotemporal control is
projected on the right STG, while Motion Right minus Spectrotemporal control is projected on the left STG (n = 3,028 [monkey 1, M1] and 2,664 [monkey
2, M2]; degrees of freedom [df] = 2,722 [M1] and 2,382 [M2]; PFWE: from 0.05 to 4 x 10−9 [M1] and from 0.05 to below 1 x 10−10 [M2]). The transparent
region within the black boundary corresponds to motion-responsive regions (defined by the contrasts Motion Left minus Silence and Motion Right minus
Silence, PFWE < 0.05) where the blood-oxygen-level-dependent (BOLD) responses induced by motion and stationary stimuli were not significantly
different. Conv., convexity; Hf, high frequency; Inf., inferior bank; Lf, low frequency; Sup., superior bank. For more details, see Fig 2 legend. Data are
available from the Open Science Framework ([Link]
[Link]
Fig 4. Motion minus Stationary contrasts (in cyan) and Motion minus Spectrotemporal control contrasts (in yellow) (Experiment 4). Voxels where
each contrast is statistically significant (PFWE < 0.05) are respectively colored in cyan and yellow (t-tests: n = 9,927 [monkey 1, M1] and 6,664 [monkey 2,
M2]; degrees of freedom [df] = 8,902 [M1] and 5,922 [M2]). The green area corresponds to voxels where both contrasts are significant. Statistical results are
shown on a surface rendering of the superior temporal gyrus (STG) contralateral to the stimuli: Motion Left minus Stationary Left/Spectrotemporal control is
projected on the right STG, while Motion Right minus Stationary Right/Spectrotemporal control is projected on the left STG. The transparent region within
the black boundary corresponds to motion-responsive regions (defined by the contrasts Motion Left minus Silence and Motion Right minus Silence, PFWE <
0.05) where the blood-oxygen-level-dependent (BOLD) responses induced by motion and stationary stimuli were not significantly different. Conv.,
convexity; Hf, high frequency; Inf., inferior bank; Lf, low frequency; Sup., superior bank. For more details, see Fig 2 legend. Data are available from the
Open Science Framework ([Link]
[Link]
responses to occur in these areas (the added constant term in the linear regression, Table 1,
p-values below 1 x 10−5 for each subject). This additional component accounted for about 42%
of the mean signal intensity induced by motion stimuli (M1: 42.5%; M2: 42.2%). A control
Fig 5. Motion minus (Stationary central sound + Spatial laterality + Spectrotemporal effect of motion) contrast (Experiment 4). Voxels where the
contrast is statistically significant (PFWE < 0.05) are colored in green (t-tests: n = 9,927 [monkey 1, M1] and 6,664 [monkey 2, M2]; degrees of freedom [df] =
8,902 [M1] and 5,922 [M2]). Statistical results are shown on a surface rendering of the superior temporal gyrus (STG) contralateral to the stimuli. The
transparent region within the black boundary corresponds to motion-responsive regions (defined by the contrasts Motion Left minus Silence and Motion
Right minus Silence, PFWE < 0.05) where the blood-oxygen-level-dependent (BOLD) response induced my motion was not significantly different than the
additive model. Conv., convexity; Hf, high frequency; Inf., inferior bank; Lf, low frequency; Sup., superior bank. For more details, see Fig 2 legend. Data are
available from the Open Science Framework ([Link]
[Link]
analysis across voxels taken within the region where the full signal could be explained by the
simple additive model (transparent patch in Fig 5) revealed similar regression coefficients but
no significant constant term (Table 1). S3 Fig illustrates the goodness of fit of the best-adjusted
model with experimental data in each subject.
“Inside green cluster” refers to the brain region depicted in green in Fig 5, where the contrasts Motion minus Silence and Motion minus (Stationary central
sound + Spatial laterality + Spectrotemporal effect of motion) were significant. “Outside green cluster” refers to transparent voxels within the black boundary
in Fig 5 and corresponds to voxels where the contrast Motion minus Silence was significant but where the contrast Motion minus (Stationary central sound
+ Spatial laterality + Spectrotemporal effect of motion) was not significant. Interaction coefficients and associated statistics are displayed only in the case
where adding interaction terms significantly improved the model (statistically significant R2 change). Monkey 1, M1; monkey 2, M2; Motion constant,
constant term of the linear regression; SE, standard error; ST, spectrotemporal effect of motion; stationary, stationary central sound process. See also S3
Fig.
[Link]
Discussion
Existence of motion-specific mechanisms
Movement selectivity has been classically investigated by comparing moving and stationary
stimuli. In humans, the contrast Motion minus Stationary has consistently revealed activation
Fig 6. Auditory (in green) and visual (in red) motion-specific areas in monkey 2 (M2). Visual motion-specific areas were identified by the contrast
Moving gratings minus Stationary gratings (Experiment 5, t-test: n = 1,241; degrees of freedom [df] = 1,067). Auditory motion data came from Experiment 4,
and auditory motion-specific areas were identified by the contrast (Motion minus (Stationary central sound + Spatial laterality + Spectrotemporal effect of
motion)) illustrated in Fig 5. The black area corresponds to voxels where both contrasts are significant. Significant statistical results (PFWE < 0.05) are shown
on a surface rendering of the superior temporal gyrus (STG) contralateral to the stimuli. Conv., convexity; Hf, high frequency; Inf., inferior bank; Lf, low
frequency; Sup., superior bank. See Fig 2 legend for more details. Data are available from the Open Science Framework ([Link]
[Link]
of the planum temporale but not Heschl’s gyrus [20,21,29–32]. While human A1 has tradition-
ally been considered to be located on the Heschl’s gyrus, recent tonotopy data suggest that A1
is rather found on the posterior half of the Heschl’s gyrus and slightly extends posteriorly into
a small part of the planum temporale [33,34]. The planum temporale could thus encompass
human homologues of macaque auditory areas CM, CL, and ML but also of the posterolateral
part of A1. According to this model, our results fit well with human data since the contrast
Motion minus Stationary induced the recruitment of the caudolateral parts of A1 and extended
into CL and ML (Experiments 1 and 4).
The contrast Motion minus Stationary controls for the intrinsic spectrotemporal content of
the motion stimuli and, when the stationary control sounds cover the whole spatial range
spanned by the motion stimulus, its nondynamic spatial component as well. However, it does
not control for the spectrotemporal effects of motion: filtering of sound through the pinna dif-
fers for each spatial position, inducing slow modulations of the sound spectral envelope. This
dynamic nonspatial component aspect has only been controlled for in one previous study [21].
In this human fMRI study, spectrotemporal effects of motion were found to be processed in
parts of the planum temporale overlapping with those involved in motion processing (revealed
by the contrast Motion minus Stationary). Our study provides similar results in macaques
(Fig 4).
Compared to the previous human study [21], our study in macaques went several steps
further. First, we tested for the first time the possibility that the addition of the different
components of auditory stimuli could explain the activation that they induced. Our results
demonstrate that the additive combination of (1) the intrinsic spectrotemporal component
(“Stationary central sound” processing), (2) the nondynamic spatial component (spatial
laterality processing), and (3) the dynamic nonspatial component (spectrotemporal effect of
motion) allows a full characterization of motion processing in large parts of the STG, including
A1. However, in a circumscribed region overlapping parts of ML, CL, the caudal parabelt, and
the inferior bank of the STG, the additive model did not explain a significant fraction of the
signal induced by motion stimuli.
Second, we controlled for potential interactions between components. This was done by
introducing in the linear models all possible interactions and testing whether the percentage of
the variance explained by the model including the interactions was significantly higher than in
the model without the interaction terms. This analysis revealed weak or no interactions
between the components.
Third, we controlled for mechanisms that can influence the gain of the three different com-
ponents (i.e., different forms of adaptation or amplification). It has been argued that greater
activation induced by moving sounds compared to stationary sounds could represent adapta-
tion of responses induced by stationary sounds [35–38]. By measuring the time course of the
hemodynamic response induced by motion and stationary sounds, here we demonstrate that
the differential activation cannot be explained by (slow) adaptation of the BOLD response trig-
gered by stationary sounds (Experiment 2). Rapid adaptation of neuronal responses could
also, in principle, explain greater activation induced by moving sounds. In the present study,
the use of an amplitude-modulated noise as a stimulus should have limited such an effect.
Moreover, adaptation or amplification mechanisms were controlled in the final linear regres-
sion analysis by the coefficients weighting the different components and their interactions.
The regression analysis revealed that the magnitude of these mechanisms was moderate (coef-
ficients close to 1) and similar between the region where part of the motion processing signal
was left unexplained and the region where the signal could be fully explained by the simple
additive model. Thus, adaptation or amplification fails to explain the unaccounted signal.
The linear regression analysis revealed that after controlling for the different processes not
specific to motion, their potential interactions, and their potential adaptation or amplification,
on average 42% of the signal variance remained unexplained. Since processes directly or indi-
rectly linked to processing of several stationary sounds were controlled for in this analysis, we
conclude that this remaining part of the signal comes from a motion-specific process.
The nature of the mechanisms underlying auditory motion perception has been debated for
more than 30 y. The “snapshot hypothesis” postulates that motion is inferred from snapshots
of object successive positions, without direct appreciation of motion. According to this
hypothesis, auditory motion perception is based on the same mechanisms as those involved in
the localization of static sound sources. The alternative hypothesis, usually referred as the
“motion detector hypothesis” or “velocity detector hypothesis”, considers that motion percep-
tion is based on specific mechanisms. On the one hand, the fact that in humans, the minimum
audible movement angle (MAMA; defined as the smallest movement angle allowing a subject
to determine whether a sound is moving or not) differs from the minimum audible angle
(MAA; defined as the smallest location difference between two static sources that subjects
could discriminate) and was found to increase with speed has been interpreted as suggesting
that motion detectors exist [3,4]. It has also been argued that if moving sounds are processed
via a snapshot process, comparing the location of the starting and ending points should be suf-
ficient to perceive movement, and information about intermediary locations should be redun-
dant. However, the MAMA for moving sounds was found to be smaller than the MAA for
tone bursts marking the starting and ending positions of the moving sound [5,39], and subjects
could discriminate between accelerating and decelerating 90 ms-long stimuli starting and end-
ing at identical spatial locations [6], indicating that the human brain extracts other informa-
tion than the location of the starting and end points of a moving sound. On the other hand,
movement detection and discrimination performances of human subjects have been explained
by estimation of the distance traversed by the source rather than appreciation of the motion
per se [1]. The MAMA and the MAA were also found to show similar dependency on sound
frequency, spectral bandwidth, and source azimuth, suggesting that static spatial cue percep-
tion and dynamic spatial cue perception are dependent on the same underlying mechanisms
[2,40]. Altogether, these data have failed to provide clear evidence about the mechanisms
underlying motion perception. Our results indicate that the parts of the auditory cortex,
including A1, analyze auditory sources in movement by processing their spatial location and
the consequence of location change (spectrotemporal effect of motion), consistent with a
“snapshot” strategy. However, we demonstrate that caudal belt and parabelt regions of audi-
tory cortex extract the motion component of moving stimuli (motion-specific process) in
addition to the non-motion specific components. The coexistence of the two mechanisms
might explain why it has been so difficult to distinguish between the snapshot and the motion
detectors hypotheses in the past. It is also relevant to psychophysical data illustrating facilita-
tion of motion perception by static spatial information [7,8].
The BOLD response measured by fMRI only provides an indirect measure of neuronal
activity. The choice of macaques as subjects of this study paves the way for a detailed investiga-
tion of the motion-specific mechanism at the cellular level. Our study indicates that motion-
specific and snapshot processes coexist in the caudal belt and parabelt regions. Electrophysio-
logical studies will be useful to determine whether the two types of processes are encoded by
different populations of neurons or not.
This study investigated the mechanisms underlying auditory motion along the azimuth axis
restricted to each hemispace. It is possible that the relative contribution of motion-specific and
snapshot mechanisms depends on the nature of the movement (in elevation, in depth, or
across hemispaces). Primates are particularly accurate at discriminating the spatial location of
sounds coming from the regions near the midline [41], and based on the main opponent-
channel hypothesis [42], the firing rate of auditory neurons contains more information about
the precise location of a sound source when it is near the midline, by opposition to the periph-
eral space. It is thus possible that the contribution of motion-specific mechanism for sounds
moving across the midline is less important than when sounds move within one hemispace.
Looming sounds are particularly relevant from a behavioral point of view, often indicating a
threat. In such sounds, information about the successive static position of the sound is limited
to monaural cues and the distance or time to arrival is systematically underestimated [43].
Thus, one might expect the relative contribution of snapshot processes to be less important.
These will be interesting hypotheses to test in the future.
Evidence for a role of the dorsal auditory pathway in spatial processing in nonhuman pri-
mates comes from electrophysiological data indicating that sensitivity to static spatial informa-
tion is higher in CL compared to A1 and the rostral belt areas [15,18,19]. Our study revealed a
similar refinement of static spatial processing between A1 and CL (see S4 Fig). Some single-
unit electrophysiological studies also highlighted the role of CM in spatial processing [17,19].
However, spatial selectivity seems to be weaker compared to CL [19], and modelling of neural
data suggests that the firing rates of CL neurons, but not of CM neurons, carry enough infor-
mation to account for sound localization performance in azimuth [16]. Using fMRI, we did
find strong and consistent BOLD activation induced by static and moving sounds in CL but
not in CM. Since the BOLD response indirectly reflects the activity of very large populations
of neurons, it is possible that at this scale, the spatial sensitivity of CM neurons cannot be
detected. Together, these results suggest that spatial sensitivity differs to some extent between
CL and CM and that the specialization for static auditory spatial processing mainly occurs
along the dorsocaudal substream.
In addition to this static spatial processing, our data demonstrate a particular specialization
for motion analysis within the dorsal-caudal substream, indicating that this stream carries out
higher-level spatial computation rather than just representing fixed space. This result indicates
the existence of parallel pathways for fixed and dynamic auditory spatial analysis within the
dorsocaudal stream that likely feed into distinct downstream mechanisms as in the visual sys-
tem. The exact number of substreams within the visual dorsal pathway and their respective
roles are still debated [49–51]. Subdivision of the human visual dorsal pathway into at least
two substreams has been proposed, with the dorsodorsal pathway involving the superior parie-
tal lobule, while the ventral-dorsal pathway involves the visual motion areas in the temporal sul-
cus (including MT) and the inferior parietal region [52,53]. Auditory motion-specific areas
described in the present study have been found to extend on the inferior bank of the STG
(equivalent of the superior bank of the temporal sulcus), in the vicinity of visual motion areas,
and our visual experiment revealed a small overlap between auditory and visual motion-selective
areas in this region. These data suggest that the auditory and visual motion substreams share
some neural substrates in the inferior bank of the STG, which might potentially support the
numerous behavioral interactions that have been reported between auditory and visual motion
perception [54,55]. It will be interesting to determine whether this region represents the point
where the auditory and visual motion substreams merge by testing whether the same population
of neurons respond to auditory and visual motion stimuli and where these neurons project.
Because the posterior auditory cortex in humans is involved not only in spatial analysis but
also in speech and music perception, recent models of the dorsal auditory stream incorporate
the idea that there may be a transformation of auditory information into a motor signal coding
for the action necessary to produce the sound [47,56,57]. While this auditory-motor function
could coexist with perceptual spatial processing in distinct substreams [47], it has also been
argued that spatial processing could be interpreted as a preparation for eye movement or grasp-
ing [58,59]. In this case, the whole dorsal pathway could be characterized as a mechanism for
auditory-motor integration, with different substreams supporting different auditory-motor pro-
cesses. We suggest that the ability to compute motion allows a substream of the auditory dorsal
pathway to predict the trajectory of sources in a way that helps visual tracking and grasping.
Experiments complied with the Animal Scientific Procedures Act (1986), the European Direc-
tive on the protection of animals used for scientific purposes (2010/63/EU), and the United
States National Institutes of Health Guidelines for the Care and Use of Animals for Experi-
mental Procedures and were performed with great care to ensure the well-being of the
animals.
Subjects
Two awake male rhesus monkeys (Macaca mulatta) M1 and M2, respectively 7 and 11 y old
(weighing 7 and 17 kg), participated in the experiments. The monkeys were initially implanted
with a head holder. All surgical procedures were performed under general anesthesia and ster-
ile conditions. Details regarding surgical procedures, postoperative care, and the cleaning of
the implant are published elsewhere [60]. The animals were first habituated to the scanner
environment over the course of several days and then enrolled in the experiments.
−40˚, 0˚, +40˚, and +80˚ (Fig 1). Finally, spectrotemporal controls of each motion stimulus
were created by averaging at each time point the signal coming from each channel and pre-
senting the stimulus diotically (Fig 1). The resulting stimuli were sounds with intensity and
spectral content varying with time like the motion stimuli but with no spatial information (sti-
muli sounding as coming from inside the head, without spatial laterality). All auditory motion
and control stimuli were 4.9 s long.
<1 x 10−19 [participant 1], 86.4/<1 x 10−19 [participant 3]), while the third participant was still
at chance level (Chi-square test, n = 240, df = 1, X2/p = 0.42/0.52, S5 Fig).
Other stimuli
Stimuli for the tonotopy experiment were based on a random-phase noise carrier with three
different passbands, 0.5–1 kHz, 2–4 kHz, and 8–16 kHz, resulting in three different stimuli
that encompassed different spectral ranges. The carriers were amplitude modulated with a
sinusoidal envelope of 90% depth at 10 Hz to achieve robust responses.
Stimuli for the visual motion localizer experiment (Experiment 5) were horizontally ori-
ented gratings (spatial frequency: 0.5 cycles/˚) of 6˚ diameter, displayed at 7˚ to the right or to
the left of the vertical meridian. Half of the stimuli were moving at a frequency of 8 Hz, while
the remaining stimuli were stationary.
Experimental design
Subjects were scanned in a sitting position, head-fixed, while engaged in a visual fixation task
(fixation window: 2˚). Eye position was monitored at 60 Hz with a camera-based system (Sen-
soriMotoric Instruments, Teltow, Germany), and correct fixation was rewarded by drops of
fruit juice.
To avoid any contamination of the stimulus-induced BOLD responses by the response
evoked by the acoustic noise of the scanner, a sparse-sampling paradigm was used for all audi-
tory experiments. Images were acquired every 10 s (acquisition time: 1.6 s), stimuli being pre-
sented during the 8.4 s silent gap. Based on a previous time course characterization of the
BOLD response in the auditory system of macaques [28], the plateau phase of the BOLD
response was targeted in experiments 1, 3, and 4 by starting acquisition of the images 5 s after
the stimulus onset. In Experiment 2, image acquisition started 2, 3, 4, and 5 s after the stimulus
onset. To obtain baseline data, stimuli were omitted in 25% of the trials prior to image acquisi-
tion. The visual localizer experiment was acquired with a continuous paradigm. Stimuli were
delivered in a pseudorandomized way, ensuring that each stimulus was presented the same
number of times within each daily session. Because we aimed to only analyze trials in which
the monkey was fixating, we interrupted the session when the monkey stopped fixation for
more than 5 min. The number of trials per stimulus therefore varied from one session to the
next, according to the monkey’s willingness to participate in the visual fixation task. Between
28 and 50 images per stimulus were acquired in each daily session. For the tonotopy experi-
ment, 3 sessions were acquired in each subject. For the first, third, and fourth auditory motion
experiments, 5, 6, and 17 sessions were acquired in M1, and 7, 6, and 14 sessions were acquired
in M2. For the hemodynamic response function experiment (Experiment 2), 11 sessions were
acquired in M1. For the visual localizer experiment (Experiment 5), 7 sessions were acquired
in M2.
Data analysis
Functional MRI data were analyzed with SPM8 ([Link] Data
acquired from each animal were processed separately in their native space. Images from each
session were first realigned to the mean EPI image. No attempt was made to coregister EPI
and structural scans. Instead, a pair consisting of a mean EPI image and a nonisotropic struc-
tural scan acquired during the same session was chosen as a reference, based on the quality of
their alignment to each other. All functional images were coregistered to this reference EPI
image, and all the nonisotropic structural scans were coregistered to the corresponding struc-
tural scan. The isotropic structural scans were coregistered to the mean of all nonisotropic
structural scans. Functional data were smoothed with a kernel of 2 mm fullwidth at half maxi-
mum, high-pass filtered with a cut-off of 300 s to account for slow signal drifts, and adjusted
for global signal fluctuations (global scaling).
In a general linear model analysis for the combined sessions of each experiment, the voxel-
wise response estimate coefficients (beta-values) and t-values (one sided t-test) for the different
contrasts of interest were calculated (head movement parameters were regressed out). Associ-
ated p-values were corrected for multiple comparisons using the FWE correction on the bilat-
eral STG (Experiments 1, 2, and 3) and for the STG contralateral to the stimuli (Experiments 4
and 5). For auditory and visual motion experiments, data acquired while subjects did not fixate
were discarded. For tonotopy experiments, all data were used.
In Experiment 4, a multiple linear regression analysis was performed across voxels in each
subject using SPSS (IBM SPSS Statistics 21.0). The analysis was first performed across the set
of voxels where the contrasts Motion Left minus (Left Stationary central sound + Left Spatial
laterality + Left Spectrotemporal effect of motion) and Motion Right minus (Right Stationary cen-
tral sound + Right Spatial laterality + Right Spectrotemporal effect of motion) performed at the
voxel level were significant (t-values > 4.1, corrected p < 0.05). In order to determine the
source of the signal that was not explained by the linear addition of components, we tested the
following model across those voxels:
First- and second-order interactions between the three explanatory factors were incorpo-
rated only if this more complex model significantly increased the percentage of variance
explained by the model. As a control, we performed the same analysis across a subset of voxels
taken from the region where the voxel-based contrasts did not induce any significant differ-
ence (t-values < 4.1, corrected p > 0.05). To match the statistical power of both analyses, the
size of this second voxel set was matched to the first one by selecting voxels with the smallest t-
values. Since the probability of false-negative results decreases with the t value, this procedure
reduced the risk of selecting false-negative voxels. Performing these analyses on smoothed and
unsmoothed data provided similar results. Only results based on unsmoothed data are
described in the Results section of the manuscript.
Supporting information
S1 Fig. Tonotopy maps. Contrast maps, representing the degree of preference for high (cyan-
blue colors) and low frequencies (red–yellow colors), are shown on a surface rendering of the
superior bank of the STG.
(TIF)
S2 Fig. Spectro-temporal effect of motion (in cyan) and spatial laterality (in yellow)
(Experiment 4). Voxels where each contrast is statistically significant (PFWE < 0.05) are
respectively colored in cyan and yellow (t-tests: N = 9927 (M1) and 6664 (M2); df = 8902 (M1)
and 5922 (M2)). The green area corresponds to voxels where both contrasts are significant 9.
Statistical results are shown on a surface rendering of the superior temporal gyrus (STG) con-
tralateral to the stimuli. Spectro-temporal effect of motion was assessed with the contrast Spec-
tro-temporal control minus Stationary central sound and spatial laterality with the contrast
Stationary Left/Right minus Stationary central sound. For more details, see Fig 2 legend.
(TIF)
S3 Fig. Multiple linear regression plots inside and outside the motion-specific brain region
(green cluster in Fig 5). The plots represent the relationship between the data estimated by
the best adjusted model (Motion = b1 x (Stationary central sound) + b2 x (Spectro-temporal
processes) + b3 x (Spatial laterality) + interactions + constant term) and the experimental data
in each subject (M1 and M2). Data from both hemispheres have been merged for each subject.
Inside the motion specific region. Number of voxels (n) = 30, F(3,26) = 40.1, p < 0.001 (M1),
n = 130, F(3, 126) = 221.9, P < 0.001 (M2); outside the motion-specific region: n = 30, F(3,26)
= 154, p < 0.001 (M1), n = 135, F(3.131) = 194.2, p < 0.001 (M2). For more details, see Table 1
legend.
(TIF)
S4 Fig. Encoding of static spatial location. Significant statistical results (PFWE < 0.05) are
shown on a surface rendering of the superior temporal gyrus (STG) contralateral to the stimuli
(N = 2466 (M1) and 3429 (M2); df = 2210 (M1) and 3071 (M2). Contra-hemisphere preference
(in blue) was assessed by the contrast Stationary Left minus Stationary Right, projected on the
right STG, and Stationary Right minus Stationary Left, projected on the left STG. These con-
trasts did not reveal any significant ipsilateral preference. The contrasts Stationary central
sound minus Stationary Right and Stationary central sound minus Stationary Left did not reveal
any preference for central sounds. Laterality preference (in red) was assessed by the contrasts
Stationary Left minus Stationary central sounds and Stationary Right minus Stationary central
sound. The black area corresponds to voxels where both contrasts were significant. This maps
illustrate the refinement of static spatial processing between A1 and the dorso-caudal regions
of the auditory cortex: while the broad location of static stimuli (left versus right hemispace)
was encoded in large parts of the auditory cortex, including A1, the more precise location of
the sounds (lateral versus central positions) was only processed in the most dorso-caudal
regions (CL, caudal parabelt, inferior bank of the STG).
(TIF)
S5 Fig. Human psychophysical data. Stimuli were moving stimuli and concatenated-static sti-
muli moving along one of four paths: from +90 to +180˚, from -90 to 0˚, from -90 to +180˚
and from 90 to 0˚. Plotted data represents the percentage of correct responses over 240 trials
that three human subjects made in the AXB psychophysical experiments. The dashed line rep-
resents chance level (50% of correct answer). : significantly different from chance level using a
chi-square test (fore detailed statistics, see text).
(TIF)
S6 Fig. Monkey eye movement recordings. Eye movements when the subject was asked to
not move his eyes (Fix, fixation spot on) and when subject heard the auditory stimulus while
free to move his eyes (stimulus presentation, fixation spot off). Auditory stimuli were left (-80
or -40˚) stationary stimuli (left) or right (40 or 80˚) stationary stimuli (pink).
(TIF)
Author Contributions
Conceptualization: Colline Poirier, Timothy D. Griffiths.
Formal analysis: Colline Poirier.
Funding acquisition: Colline Poirier, Li Sun, Adrian Rees, Alexander Thiele, Timothy D.
Griffiths.
Investigation: Colline Poirier, Adrian Rees.
Methodology: Colline Poirier, Simon Baumann, Pradeep Dheerendra, Adrian Rees, Alexander
Thiele, Timothy D. Griffiths.
Project administration: Colline Poirier, Timothy D. Griffiths.
Resources: David Hunter, Fabien Balezeau, Li Sun, Christopher I. Petkov, Alexander Thiele.
Software: Pradeep Dheerendra, Olivier Joly.
Supervision: Adrian Rees, Alexander Thiele, Timothy D. Griffiths.
Visualization: Colline Poirier.
Writing – original draft: Colline Poirier.
Writing – review & editing: Simon Baumann, Pradeep Dheerendra, Olivier Joly, David
Hunter, Fabien Balezeau, Li Sun, Adrian Rees, Christopher I. Petkov, Alexander Thiele,
Timothy D. Griffiths.
References
1. Grantham DW. Detection and discrimination of simulated motion of auditory targets in the horizontal
plane. J Acoust Soc Am. 1986; 79(6):1939–49. PMID: 3722604
2. Chandler DW, Grantham DW. Minimum audible movement angle in the horizontal plane as a function of
stimulus frequency and bandwidth, source azimuth, and velocity. J Acoust Soc Am. 1992; 91(3):1624–
36. PMID: 1564199
3. Perrott DR, Musicant AD. Minimum auditory movement angle: binaural localization of moving sound
sources. J Acoust Soc Am. 1977; 62(6):1463–6. PMID: 591679
4. Perrott DR, Musicant AD. Dynamic minimum audible angle: binaural spatial acuity with moving sound
sources. J Audiol Res. 1981; 21:287–96.
5. Perrott DR, Malborough K. Minimum audible movement angle: Marking the end points of the path trav-
eled by a moving sound source. J Acoust Soc Am. 1989; 85(4):1773–5. PMID: 2708691
6. Perrott DR, Costantino B, Ball J. Discrimination of moving events which accelerate or decelerate over
the listening interval. J Acoust Soc Am. 1993; 93(2):1053–7. PMID: 8445116
7. Carlile S, Best V. Discrimination of sound source velocity in human listeners. J Acoust Soc Am. 2002;
111(2):1026–35. PMID: 11863159
8. Getzmann S. Effects of velocity and motion-onset delay on detection and discrimination of sound
motion. Hear Res. 2008; 246(1–2):44–51. [Link] PMID:
18848613
9. Locke SM, Leung J, Carlile S. Sensitivity to Auditory Velocity Contrast. Sci Rep. 2016; 6:27725. https://
[Link]/10.1038/srep27725 PMID: 27291488
10. Ahissar M, Ahissar E, Bergman H, Vaadia E. Encoding of sound-source location and movement: activity
of single neurons and interactions between adjacent neurons in the monkey auditory cortex. J Neuro-
physiol. 1992; 67(1):203–15. PMID: 1552320
11. Spitzer MW, Semple MN. Responses of inferior colliculus neurons to time-varying interaural phase dis-
parity: effects of shifting the locus of virtual motion. J Neurophysiol. 1993; 69:1245–63. PMID: 8492161
12. Wilson WW, O’Neill WE. Auditory motion induces directionally dependent receptive field shifts in inferior
colliculus neurons. J Neurophysiol. 1998; 79(4):2040–62. PMID: 9535967
13. McAlpine D, Jiang ZD, Shackleton TM, Palmer AR. Responses of neurons in the inferior colliculus to
dynamic interaural phase cues: evidence for a mechanism of binaural adaptation. J Neurophysiol.
2000; 83(3):1356–65. PMID: 10712463
14. Ingham NJ, Hart HC, McAlpine D. Spatial receptive fields of inferior colliculus neurons to auditory appar-
ent motion in free field. J Neurophysiol. 2001; 85(1):23–33. PMID: 11152702
15. Kusmierek P, Rauschecker JP. Selectivity for space and time in early areas of the auditory dorsal
stream in the rhesus monkey. J Neurophysiol. 2014; 111(8):1671–85. [Link]
2013 PMID: 24501260
16. Miller LM, Recanzone GH. Populations of auditory cortical neurons can accurately encode acoustic
space across stimulus intensity. Proc Natl Acad Sci U S A. 2009; 106(14):5931–5. [Link]
1073/pnas.0901023106 PMID: 19321750
17. Recanzone GH, Guard DC, Phan ML, Su TK. Correlation between the activity of single auditory cortical
neurons and sound-localization behavior in the macaque monkey. J Neurophysiol. 2000; 83:2723–39.
PMID: 10805672
18. Tian B, Reser D, Durham A, Kustov A, Rauschecker JP. Functional Specialization in Rhesus Monkey
Auditory Cortex. Science (80-). 2001; 292(5515):290–3.
19. Woods TM, Lopez SE, Long JH, Rahman JE, Recanzone GH. Effects of Stimulus Azimuth and Intensity
on the Single-Neuron Activity in the Auditory Cortex of the Alert Macaque Monkey. J Neurophysiol.
2006; 96:3323–37. [Link] PMID: 16943318
20. Baumgart F, Gaschler-markefski B, Woldorff MG, Hans-Jochen H, Henning S. A movement-sensitive
area in auditory cortex. Nature. 1999; 400:725–6.
21. Warren JD, Zielinski BA, Green GGR, Rauschecker JP, Griffiths TD. Perception of sound-source
motion by the human brain. Neuron. 2002; 34(1):139–48. PMID: 11931748
22. Griffiths TD, Rees A, Witton C, Shakir RA, Henning GB, Green GG. Evidence for a sound movement
area in the human cerebral cortex. Nature. 1996; 383(6599):425–7. [Link]
PMID: 8837772
23. Ducommun CY, Michel CM, Clarke S, Adriani M, Seeck M, Landis T, et al. Cortical motion deafness.
Neuron. 2004; 43:765–77. [Link] PMID: 15363389
24. Lewald J, Peters S, Corballis MC, Hausmann M. Perception of stationary and moving sound following
unilateral cortectomy. Neuropsychologia. 2009; 47(4):962–71. [Link]
neuropsychologia.2008.10.016 PMID: 19022269
25. Thaler L, Paciocco J, Daley M, Lesniak GD, Purcell DW, Fraser JA, et al. A selective impairment of per-
ception of sound motion direction in peripheral space: A case study. Neuropsychologia. 2016; 80:79–
89. [Link] PMID: 26586155
26. Brown CH, Schessler T, Moody MD, Stebbins WC. Vertical and horizontal sound localization in pri-
mates. J Acoust Soc Am. 1982; 72:1804–11. PMID: 7153427
27. Perrott DR, Saberi K. Minimum audible angle thresholds for sources varying in both elevation and azi-
muth. J Acoust Soc Am. 1990; 87(4):1728–31. PMID: 2341677
28. Baumann S, Griffiths TD, Rees A, Hunter D, Sun L, Thiele A. Characterisation of the BOLD response
time course at different levels of the auditory pathway in non-human primates. Neuroimage. 2010; 50
(3):1099–108. [Link] PMID: 20053384
29. Pavani F, Macaluso E, Warren JD, Driver J, Griffiths TD. A common cortical substrate activated by hori-
zontal and vertical sound movement in the human brain. Curr Biol. 2002; 12(18):1584–90. PMID:
12372250
30. Krumbholz K, Schönwiesner M, Von Cramon DY, Rubsamen R, Shah NJ, Zilles K, et al. Representation
of interaural temporal information from left and right auditory space in the human planum temporale and
inferior parietal lobe. Cereb Cortex. 2005; 15(3):317–24. [Link] PMID:
15297367
31. Poirier C, Collignon O, DeVolder AG, Renier L, Vanlierde A, Tranduy D, et al. Specific activation of the
V5 brain area by auditory motion processing: An fMRI study. Cogn Brain Res. 2005; 25(3):650–8.
32. Meng J-A, Saberi K, Hsieh I-H. Velocity Selective Networks in Human Cortex Reveal Two Functionally
Distinct Auditory Motion Systems. PLoS ONE [Internet]. 2016; 11(6):e0157131. Available from: http://
[Link]/10.1371/[Link].0157131 [Link] PMID:
27294673
33. Baumann S, Petkov CI, Griffiths TD. A unified framework for the organization of the primate auditory
cortex. Front Syst Neurosci. 2013; 7:11. [Link] PMID: 23641203
34. Saenz M, Langers DRM. Tonotopic mapping of human auditory cortex. Hear Res. 2014; 307:42–52.
[Link] PMID: 23916753
35. Smith KR, Okada K, Saberi K, Hickok G. Human cortical auditory motion areas are not motion selective.
Neuroreport. 2004; 15(9):1523–6. PMID: 15194888
36. Smith KR, Saberi K, Hickok G. An event-related fMRI study of auditory motion perception: No evidence
for a specialized cortical system. Brain Res. 2007; 1150(1):94–9.
37. Krumbholz K, Schönwiesner M, Rubsamen R, Zilles K, Fink GR, Von Cramon DY. Hierarchical process-
ing of sound location and motion in the human brainstem and planum temporale. Eur J Neurosci. 2005;
21(1):230–8. [Link] PMID: 15654860
38. Krumbholz K, Hewson-Stoate N, Schönwiesner M. Cortical response to auditory motion suggests an
asymmetry in the reliance on inter-hemispheric connections between the left and right auditory cortices.
J Neurophysiol. 2007; 97(2):1649–55. [Link] PMID: 17108095
39. Grantham DW. Auditory motion perception: Snapshots revisited. In: Gilkey R.H. and Anderson TR, edi-
tor. Binaural and Spatial Hearing in Real and Virtual Environments. Mahwah, NJ: Lawrence Erlbaum
Associates; 1997. p. 295–313.
40. Perrott DR, Tucker J. Minimum audible movement angle as a function of the azimuth and elevation of
the source. J Acoust Soc Am. 1988; 83(4):1522–7. PMID: 3372867
41. Mills AW, Movements H, Sound D. On the minimum audible angle. J Acoust Soc Am. 1985; 30(4):237–
46.
42. Stecker GC, Harrington IA, Middlebrooks JC. Location Coding by Opponent Neural Populations in the
Auditory Cortex. PLoS Biol. 2005; 3(3):520–8.
43. Bach DR, Neuhoff JG, Perrig W, Seifritz E. Looming sounds as warning signals : The function of motion
cues. Int J Psychophysiol. 2009; 74(1):28–33. [Link] PMID:
19615414
44. Romanski LM, Averbeck BB. The primate cortical auditory system and neural representation of conspe-
cific vocalizations. Annu Rev Neurosci. 2009; 32:315–46. [Link]
051508.135431 PMID: 19400713
45. Belin P, Zatorre RJ. “What”, “where” and “how” in auditory cortex. Nat Neurosci. 2000; 3(10):965–6.
[Link] PMID: 11017161
46. Kaas JH, Hackett TA. Subdivisions of auditory cortex and processing streams in primates. Proc Natl
Acad Sci U S A. 2000; 97(22):11793–9. [Link] PMID: 11050211
47. Hickok G, Poeppel D. The cortical organization of speech processing. Nat Rev Neurosci. 2007; 8
(5):393–402. [Link] PMID: 17431404
48. Hackett TA, de la Mothe LA, Camalier CR, Falchier A, Lakatos P, Kajikawa Y, et al. Feedforward and
feedback projections of caudal belt and parabelt areas of auditory cortex: Refining the hierarchical
model. Front Neurosci. 2014; 8:1–21.
49. Kravitz DJ, Saleem KS, Baker CI, Mishkin M. A new neural framework for visuospatial processing. Nat
Rev Neurosci. 2011; 12(4):217–30. [Link] PMID: 21415848
50. Chafee M V, Crowe D a. Thinking in spatial terms: decoupling spatial representation from sensorimotor
control in monkey posterior parietal areas 7a and LIP. Front Integr Neurosci. 2012; 6:112. [Link]
org/10.3389/fnint.2012.00112 PMID: 23355813
51. Binkofski F, Buxbaum LJ. Two action systems in the human brain. Brain Lang. 2013; 127(2):222–9.
[Link] PMID: 22889467
52. Rizzolatti G, Matelli M. Two different streams form the dorsal visual system: Anatomy and functions.
Exp Brain Res. 2003; 153(2):146–57. [Link] PMID: 14610633
53. Pisella L, Binkofski F, Lasek K, Toni I, Rossetti Y. No double-dissociation between optic ataxia and
visual agnosia: Multiple sub-streams for multiple visuo-manual integrations. Neuropsychologia. 2006;
44(13):2734–48. [Link] PMID: 16753188
54. Mateeff S, Hohnsbein J, Noack T. Dynamic visual capture: apparent auditory motion induced by a mov-
ing visual target. Perception. 1985; 14:721–7. [Link] PMID: 3837873
55. Lakatos S. The influence of visual cues on the localisation of circular auditory motion. Perception. 1995;
24:457–65. [Link] PMID: 7675624
56. Warren JE, Wise RJS, Warren JD. Sounds do-able: Auditory-motor transformations and the posterior
temporal plane. Trends Neurosci. 2005; 28(12):636–43. [Link]
PMID: 16216346
57. Zatorre RJ, Chen JL, Penhune VB. When the brain plays music: auditory-motor interactions in music
perception and production. Nat Rev Neurosci. 2007; 8(7):547–58. [Link]
PMID: 17585307
58. Recanzone GH, Cohen YE. Serial and parallel processing in the primate auditory cortex revisited.
Behav Brain Res. 2010; 206:1–7. [Link] PMID: 19686779
59. Rauschecker JP, Scott SK. Maps and streams in the auditory cortex: nonhuman primates illuminate
human speech processing. Nat Neurosci. 2009; 12(6):718–24. [Link] PMID:
19471271
60. Thiele A, Delicato LS, Roberts MJ, Gieselmann MA. A novel electrode-pipette design for simultaneous
recording of extracellular spikes and iontophoretic drug application in awake behaving monkeys. J Neu-
rosci Methods. 2006; 158(2):207–11. [Link] PMID: 16843532
61. Henning GB. Detectability of interaural delay in high-frequency complex waveforms. J Acoust Soc Am.
1973; 55:84–90.
62. Wightman FL, Kistler DJ. Headphone simulation of free-field listening. I: Stimulus synthesis. J Acoust
Soc Am. 1989; 85:858–67. PMID: 2926000
63. Recanzone GH, Beckerman NS. Effects of intensity and location on sound location discrimination in
macaque monkeys. Hear Res. 2004; 198:116–24. [Link] PMID:
15567608