keywords

Speech and language perception and processing, multisensory integration, cognitive psychology, cognitive development

speech in context

The human speech signal is highly variable and complex. Nevertheless, we usually have no trouble understanding a speaker, because we use the context in which the speech signal appears to decipher the spoken message.

My research focuses on how, and when, context information influences the way in which the speech signal is processed and perceived. I use behavioral methods as well as techniques that capture the underlying brain processes such as Electroencephalography (EEG).

postdoctoral

Postdoctoral researcher at Tilburg University, dept of Cognitive Neuropsychology, Tilburg, the Netherlands
• 2016 - present

Affiliated researcher at the Basque Center on Cognition Brain and Language, Donostia - San Sebastián, Spain
• 2017 - present

Postdoctoral researcher at the Basque Center on Cognition Brain and Language, Donostia - San Sebastián, Spain
• 2012 - 2017

predoctoral

PhD student at Tilburg University, dept of Medical psychology and Neuropsychology, Tilburg, the Netherlands
• 2007 - 2012

Visiting researcher at the University of Connecticut, dept of Psychology, Storrs, & Haskins Laboratories, New Haven, CT, USA
• Fall 2010

journal articles

Baart, M., & Vroomen, J. (2018). Recalibration of vocal affect by a dynamic face. Experimental Brain Research, 236(7), 1911-1918. doi:10.1007/s00221-018-5270-y

Baart, M., Lindborg, A., & Andersen, T. S. (2017). Electrophysiological evidence for differences between fusion and combination illusions in audiovisual speech perception. European Journal of Neuroscience,46(10), 2578-2583. doi:10.1111/ejn.13734

Baart, M., Armstrong, B. C., Martin, C. D., Frost, R., & Carreiras, M. (2017). Cross-modal noise compensation in audiovisual words. Scientific Reports, 7:42055. doi:10.1038/srep42055

Baart, M. (2016). Quantifying lip-read induced suppression and facilitation of the auditory N1 and P2 reveals peak enhancements and delays. Psychophysiology, 53(9), 1295-1306. doi:10.1111/psyp.12683

Baart, M., & Samuel, A. G. (2015). Turning a blind eye to the lexicon: ERPs show no cross-talk between lip-read and lexical context during speech sound processing. Journal of Memory and Language, 85, 42-59. doi:10.1016/j.jml.2015.06.008

Shaw, K., Baart, M., Depowski, N., & Bortfeld, H. (2015). Infants’ preference for native audiovisual speech dissociated from congruency preference. PLOS ONE, 10(4): e0126059. doi:10.1371/journal.pone.0126059

Baart, M., & Samuel, A. G. (2015). Early processing of auditory lexical predictions revealed by ERPs. Neuroscience Letters, 585, 98-102. doi:10.1016/j.neulet.2014.11.044

Baart, M., Bortfeld, H., & Vroomen, J. (2015). Phonetic matching of auditory and visual speech develops during childhood: Evidence from sine-wave speech. Journal of Experimental Child Psychology, 129, 157-164. doi:10.1016/j.jecp.2014.08.002

Baart, M., Stekelenburg, J. J., & Vroomen, J. (2014). Electrophysiological evidence for speech-specific audiovisual integration. Neuropsychologia, 53, 115-121. doi:10.1016/j.neuropsychologia.2013.11.011

Baart, M., Vroomen, J., Shaw, K., & Bortfeld, H. (2014). Degrading phonetic information affects matching of audiovisual speech in adults, but not in infants. Cognition, 130(1), 31-43. doi:10.1016/j.cognition.2013.09.006

Baart, M., de Boer-Schellekens, L., & Vroomen, J. (2012). Lipread induced recalibration in Dyslexia. Acta Psychologica, 140, 91-95. doi:10.1016/j.actpsy.2012.03.003

Baart, M., & Vroomen, J. (2010). Phonetic recalibration does not depend on working memory. Experimental Brain Research, 203, 575-582. doi:10.1007/s00221-010-2264-9

Baart, M., & Vroomen, J. (2010). Do you see what you are hearing? Cross-modal effects of speech sounds on lipreading. Neuroscience Letters, 471, 100-103. doi:10.1016/j.neulet.2010.01.019

Vroomen, J., & Baart, M. (2009). Recalibration of phonetic categories by lipread speech: Measuring aftereffects after a twenty-four hours delay. Language and Speech, 52, 341-350. doi:10.1177/0023830909103178

Vroomen, J., & Baart, M. (2009). Phonetic recalibration only occurs in speech mode. Cognition, 110, 254-259. doi:10.1016/j.cognition.2008.10.015

books & chapters

Baart, M. (2012). Phonetic Recalibration in audiovisual speech (Doctoral dissertation). Tilburg University, the Netherlands. Printed by Ridderprint BV, Ridderkerk, ISBN: 978-90-5335-511-4.

Vroomen, J., & Baart, M. (2012). Phonetic recalibration in audiovisual speech. in M. M. Murray and M. T. Wallace (Eds.), The neural bases of multisensory processes. (pp. 363-379). Boca raton (FL): CRC Press.

proceedings

Zouridakis, G., Baart, M., Stekelenburg, J. J., & Vroomen, J. (2013). Speech perception: single trial analysis of the N1/P2 complex of unimodal and audiovisual evoked responses. Proceedings of the 13th IEEE International Conference on Bioinformatics and Bioengineering, (paper ID 165), Chania, Greece. doi:10.1109/BIBE.2013.6701590

Baart, M., Vroomen, J., Shaw, K., & Bortfeld, H. (2013). Phonetic information in audiovisual speech is more important for adults than for infants; preliminary findings. Proceedings of the 12th International Conference on Auditory-Visual Speech Processing, (pp. 61 - 64), Annecy, France. full text online

Vroomen, J., van Linden, S., & Baart, M. (2007). Lipread aftereffects in auditory speech perception: Measuring aftereffects after a twenty-four hours delay. Proceedings of the 7th International Conference on Auditory-Visual Speech Processing, (paper P05), Hilvarenbeek, the Netherlands. full text online

invited talks

Baart, M. Audiovisual speech integration is (not) speech-specific. University of Toronto, June 13, 2018, Toronto, Canada.

Baart, M. Perceiving non-speech as speech based on a moving mouth. Findings from infants, children, and adults. Beyond Language Learning Workshop, September 29 - 30, 2016, Barcelona, Spain.

Baart, M. Hearing with our eyes. Brain Awareness Week, March 9 - 13, 2015, Donostia - San Sebastian, Spain.

conference contributions

Baart, M., Keetels, M., & Vroomen, J. Recalibration of vocal affect by a dynamic or static face. Poster presentation at the 19th International Multisensory Research Forum (IMRF), June 14 - 17, 2018, Toronto, Canada.

Burgering, M. A., Baart, M., & Vroomen, J. Audiovisual recalibration and selective adaptation for vowels and speaker sex. Poster presentation at the 19th International Multisensory Research Forum (IMRF), June 14 - 17, 2018, Toronto, Canada.

Lindborg, A., Baart, M., & Andersen, T. S. Electrophysiological evidence for differences between fusion and combination illusions in audiovisual speech perception. Poster presentation at the 19th International Multisensory Research Forum (IMRF), June 14 - 17, 2018, Toronto, Canada.

Baart, M. & Vroomen, J. Lip-read speech but not sentential context produces top-up effect on lexical bias. Poster presentation at the Psychonomics International meeting, May 10 - 12, 2018, Amsterdam, the Netherlands.

López Zunini, R. A., Armstrong, B. C., Baart, M., & Samuel, A. G. Processing dynamics of hearing and seeing words under (no) time pressure: Insights from behaviour, ERPs and mixed-effect models. Poster presentation at the Psychonomics International meeting, May 10 - 12, 2018, Amsterdam, the Netherlands.

Baart, M., & Vroomen, J. Hearing an emotional face: Visual emotion recalibrates auditory perception. Poster presentation at the NVP Winter Conference, December 14 - 16, 2017, Egmond aan Zee, the Netherlands.

Guediche, S., Baart, M., & Samuel, A. G. Effects of Semantic Context and Crosslinguistic Interactions on Non-Native Word Recognition in Noise. Poster presentation at the Annual Meeting of the Psychonomic Society, November 9 - 12, 2017, Vancouver, Canada.

Kartushina, N., Baart, M. & Martin, C. D. The role of stimulus variability in nonnative sound production learning: evidence from behavioral and neuronal measures. Poster presentation at the 20th Conference of the European Society for Cognitive Psychology (ESCoP), September 3 - 6, 2017, Potsdam, Germany.

Bortfeld, H., Shaw, K. E., & Baart, M. Infant sensitivity to audiovisual timing driven by articulator-speech sound relationship. Poster presentation at the 18th International Multisensory Research Forum (IMRF), May 19 -22, 2017, Nashville, USA.

Baart, M. Quantifying early electrophysiological effects of audiovisual speech integration. Poster presentation at the 22nd conference on Architectures and Mechanisms for Language Processing (AMLaP), September 1-3, 2016, Bilbao, Spain.

Lindborg, A., Baart, M., & Andersen, T. Speech specific audiovisual integration suppresses induced theta-band oscillations. Poster at the 17th International Multisensory Research Forum (IMRF), June 15 -18, 2016, Suzhou, China.

Baart, M. Digitizing the electrophysiological N1 and P2 to reveal general effects of audiovisual speech integration. Poster presentation at the 16th International Multisensory Research Forum (IMRF), June 13-16, 2015, Pisa, Italy.

Baart, M., & Samuel, A.G. The N200 Lexicality Effect is Unaffected by Lip-read Context. Poster presentation at the Annual Meeting of the Psychonomic Society, November 20 - 23, 2014, Long Beach, USA.

Shaw, K., Gaafar, J., Baart, M., & Bortfeld, H. Infants perceptually tune to multisensory Speech. Poster presentation at the Annual Meeting of the Psychonomic Society, November 20 - 23, 2014, Long Beach, USA.

Baart, M., & Samuel, A. G. Early robust auditory lexical processing revealed by ERPs. Poster presentation at the 6th Annual Meeting of the Society for the Neurobiology of Language, August 27 - 29, Amsterdam, The Netherlands.

Bortfeld, H., Shaw, K., & Baart, M. Infants can perceive audiovisual speech asynchrony (if it’s asynchronous enough). Poster presentation at the 6th Annual Meeting of the Society for the Neurobiology of Language (SNL), August 27 - 29, Amsterdam, The Netherlands.

Molnar, M., Quiñones, I., Baart, M., Caballero-Gaudes, C., Peña, M., & Carreiras, M. Neural specialization for native speech processing in young Basque-Spanish monolingual and bilingual infants. Talk at the 2nd Basque Neuroscience Meeting (Neurogune), July 9, 2014, Donostia, Spain.

Shaw, K., Baart, M., & Bortfeld, H. Infants can perceive asynchronies in audiovisual speech. Talk at the 15th International Multisensory Research Forum (IMRF), June 11 - 14, 2014, Amsterdam, The Netherlands.

Baart, M., & Samuel, A.G. Audiovisual speech integration is not modulated by the lexicon. Poster presentation at the 15th International Multisensory Research Forum (IMRF), June 11 - 14, 2014, Amsterdam, The Netherlands.

Zouridakis, G., Baart, M., Stekelenburg, J. J., & Vroomen, J. Speech perception: single trial analysis of the N1/P2 complex of unimodal and audiovisual evoked responses. Talk at the 13th IEEE International Conference on Bioinformatics and Bioengineering, November 10 - 13, 2013, Chania, Greece.

Molnar, M., Peña, M., Caballero, C., Baart, M., Quiñones, I., & Carreiras, M. Different neural specializations support native speech processing of young monolingual and bilingual infants. Talk at the 5th Annual Meeting of the Society for the Neurobiology of Language, November 6 - 8, 2013, San Diego, USA.

Bortfeld, H., Baart, M., Shaw, K., & Vroomen, J. Infants’ audiovisual speech integration does not hinge on phonetic knowledge. Poster presentation at the 5th Annual Meeting of the Society for the Neurobiology of Language, November 6 - 8, 2013, San Diego, USA.

Molnar, M., Peña, M., Quiñones, I., Baart, M., Caballero, C., & Carreiras, M. Monolingual and bilingual infants follow different developmental patterns in neural specialization of native speech processing. Poster presentation at the Boston University Conference on Language Development (BUCLD), November 2, 2013, Boston, USA.

Molnar, M., Peña, M., Quiñones, I., Baart, M., Caballero, C. & Carreiras, M. Native speech processing is supported by different neural specialization in young monolingual and bilingual infants. Talk at the International Conference on Multilingualism, October 24 - 25, 2013, Montreal, Canada.

Molnar, M., Peña, M., Gervain, J., Baart, M., Quiñones, I., & Carreiras, M. Language discrimination abilities of young Basque-Spanish bilingual infants. Talk at the VIIth International Conference on Language Acquisition (AEAL), September 4 - 6, 2013, Bilbao, Spain.

Baart, M., Vroomen, J., Shaw, K., & Bortfeld, H. Phonetic information in audiovisual speech is more important for adults than for infants; preliminary findings. Talk at the 12th International Conference on Auditory-Visual Speech Processing, August 29 - September 1, 2013, Annecy, France.

Molnar, M., Gervain, J., Peña, M., Baart, M., Quiñones, I., & Carreiras, M. Language discrimination in monolingual and bilingual infants of Spanish and Basque. Talk at the Workshop on Infant Language Development, June 20 - 22, 2013, Donostia - San Sebastian, Spain.

Baart, M., Vroomen, J., Shaw, K., & Bortfeld, H. Infants' audiovisual speech integration does not hinge on phonetic knowledge. Poster presentation at the Workshop on Infant Language Development, June 20 - 22, 2013, Donostia - San Sebastian, Spain.

Baart, M., de Boer-Schellekens, L., & Vroomen, J. Lipread-induced phonetic recalibration in Dyslexia. Poster presentation at the International Workshop on Reading and Developmental Dyslexia, May 30 June 1, 2013, Donostia - San Sebastian, Spain.

Shaw, K. E., Bortfeld, H., Baart, M., & Vroomen. J. Infants' audiovisual speech integration hinges on underlying temporal dynamics: Evidence from sine wave speech. Poster presentation at Biennial Meeting of the Society for Research in Child Development, April 18 - 20, 2013, Seattle, USA.

Baart, M., Vroomen, J., Shaw, K., & Bortfeld, H. Infants' audiovisual speech integration does not hinge on phonetic knowledge. Poster presentation at the 5th Workshop on Speech in Noise, January 10 - 11, 2013, Vitoria-Gasteiz, Spain.

Baart, M., Vroomen, J., Shaw, K., & Bortfeld, H. Adults rely on phonetic cues when processing audiovisual speech, infants do not. Or do they? Talk at the Annual Meeting of the Psychonomic Society, November 15 - 18, 2012, Minneapolis, USA.

Shaw, K., Depowski, N., Baart, M., & Bortfeld, H. Relative influence of language familiarity and congruency in early audiovisual integration. Poster presentation at Annual Meeting of the Psychonomic Society, November 15 - 18, 2012, Minneapolis, USA.

Baart, M., Vroomen, J., Shaw, K., & Bortfeld, H. Infants do not benefit from phonetic information in audiovisual speech; Evidence from Sine-wave speech. Talk at the Mini-workshop on word recognition in monolingual and bilingual infants and adults, November 12, 2012, Donostia - San Sebastian, Spain.

Depowski, N., Gruenbaum, B., Shaw, K., Baart, M., & Bortfeld, H. Language-specific tuning of audiovisual integration in early development. Poster presentation at the XVIII Biennial International Conference on Infant Studies, June 7 - 9, 2012, Minneapolis, USA.

Baart, M., Bortfeld, H., & Vroomen, J. Preferential looking to audiovisual (sine wave) speech in infants. Talk at the Symposium on Auditory Cognition, March 2, 2012, Tilburg, the Netherlands.

Baart, M., & Vroomen, J. Phonetic recalibration does not depend on working memory. Poster presentation at the 11th International Multisensory Research Forum, June 16 - 19, 2010, Liverpool, United Kingdom.

Vroomen, J., & Baart, M. Phonetic recalibration only occurs in speech mode. Poster presentation at the 10th International Multisensory Research Forum, June 29 - July 2, 2009, New York, USA.

Baart, M., & Vroomen, J. Recalibration of phonetic categories by lipread speech: measuring aftereffects after a twenty-four hours delay. Poster presentation at the 9th International Multisensory Research Forum, July 16 - 19, 2008, Hamburg, Germany.

Vroomen, J., & Baart, M. Lipread induced recalibration of phonetic categories: 'speech mode' vs. 'non-speech mode'. Talk at the Dag van de Perceptie (Day of perception), June 20, 2008, TNO Soesterberg, the Netherlands.

Vroomen, J., van Linden, S. & Baart, M. Lipread aftereffects in auditory speech perception: measuring aftereffects after a twenty-four hours delay. Poster presentation at the Auditory-Visual Speech Processing Conference, August 31 - September 3, 2007, Hilvarenbeek, the Netherlands.

graduate courses

Quantitative Methods; basic statistical concepts
Basque Center on Cognition Brain and Language & University of the Basque Country (UPV/EHU), Donostia - San Sebastián, Spain
• 2012 - 2016

undergraduate courses

Experimental psychology (Course ID 530038)
Tilburg University, Tilburg, the Netherlands
• 2017 -

Academic skills (Course ID 500182)
Tilburg University, Tilburg, the Netherlands
• 2017 -

Research practical in psychology
Tilburg University, Tilburg, the Netherlands
• 2007 - 2009

workshops

ERP processing and theory
Basque Center on Cognition Brain and Language, Donostia - San Sebastián, Spain
• Summer 2016

ERP processing and analysis
Basque Center on Cognition Brain and Language, Donostia - San Sebastián, Spain
• January 2014

personal

Veni
the Netherlands Organization for Scientific Research (NWO)
Grant ID: 275-89-027, Speech perception driven by context
• 2016 - present

Postdoctoral grant (Ayuda Formación Posdoctoral)
Spanish Ministry of Economy and Competitiveness (MINECO)
Grant ID: FPDI-2013-15661
• 2014 - 2016

Rubicon
the Netherlands Organization for Scientific Research (NWO)
Grant ID: Rubicon 446-11-01, Unraveling the time-course of phonetic binding.
• 2012 - 2014

Fulbright visiting scholar fellowship
Fulbright Center, the Netherlands/America Commission for Educational Exchange
Grant ID: Infants' speech mode
• 2010

other

National research grant (Subprograma Estatal de Generación de Conocimiento) with Marie Pourquié (co-pi)
Spanish Ministry of Economy and Competitiveness (MINECO)
Grant ID: PSI2014-51874-P, El cerebro hablante: sano y multisensorial
• 2015 - 2017