Brain representation of acoustic features during goal-oriented dialogues

During dialogue, speakers have to rapidly represent different aspects of speech in order to respond and continue engaged. In particular, acoustic aspects indicate different intentions or emotions. Understanding how the brain represents those characteristics, both spatially and temporally, is importa...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Gonzalez, Joaquín, Nieto, Nicolás, Veneziano, Mauro, Brusco, Pablo, Gravano, Agustín, Kamienkowski, Juan E.
Formato: Objeto de conferencia
Lenguaje:Inglés
Publicado: 2021
Materias:
Acceso en línea:http://sedici.unlp.edu.ar/handle/10915/140171
http://50jaiio.sadio.org.ar/pdfs/asai/ASAI-02.pdf
Aporte de:
id I19-R120-10915-140171
record_format dspace
institution Universidad Nacional de La Plata
institution_str I-19
repository_str R-120
collection SEDICI (UNLP)
language Inglés
topic Ciencias Informáticas
Electroencephalography
Natural Speech
Encoding
spellingShingle Ciencias Informáticas
Electroencephalography
Natural Speech
Encoding
Gonzalez, Joaquín
Nieto, Nicolás
Veneziano, Mauro
Brusco, Pablo
Gravano, Agustín
Kamienkowski, Juan E.
Brain representation of acoustic features during goal-oriented dialogues
topic_facet Ciencias Informáticas
Electroencephalography
Natural Speech
Encoding
description During dialogue, speakers have to rapidly represent different aspects of speech in order to respond and continue engaged. In particular, acoustic aspects indicate different intentions or emotions. Understanding how the brain represents those characteristics, both spatially and temporally, is important for developing better interactive systems. In this work, we analyse electroencephalography (EEG) data and audio recordings from ten participants engaged in a dialogue during a collaborative task. We aim to better understand how the envelope of the previous instants of the speech is encoded in the brain. Our results showed a good performance in predicting EEG signals, in particular in frontal electrodes. Moreover, our findings suggest that the brain encodes the speech envelope information with a latency between 0 and 100ms. These results are widely consistent between participants and also with previous work. The present work paves the way for studying brain representations of speech in natural scenarios with EEG.
format Objeto de conferencia
Objeto de conferencia
author Gonzalez, Joaquín
Nieto, Nicolás
Veneziano, Mauro
Brusco, Pablo
Gravano, Agustín
Kamienkowski, Juan E.
author_facet Gonzalez, Joaquín
Nieto, Nicolás
Veneziano, Mauro
Brusco, Pablo
Gravano, Agustín
Kamienkowski, Juan E.
author_sort Gonzalez, Joaquín
title Brain representation of acoustic features during goal-oriented dialogues
title_short Brain representation of acoustic features during goal-oriented dialogues
title_full Brain representation of acoustic features during goal-oriented dialogues
title_fullStr Brain representation of acoustic features during goal-oriented dialogues
title_full_unstemmed Brain representation of acoustic features during goal-oriented dialogues
title_sort brain representation of acoustic features during goal-oriented dialogues
publishDate 2021
url http://sedici.unlp.edu.ar/handle/10915/140171
http://50jaiio.sadio.org.ar/pdfs/asai/ASAI-02.pdf
work_keys_str_mv AT gonzalezjoaquin brainrepresentationofacousticfeaturesduringgoalorienteddialogues
AT nietonicolas brainrepresentationofacousticfeaturesduringgoalorienteddialogues
AT venezianomauro brainrepresentationofacousticfeaturesduringgoalorienteddialogues
AT bruscopablo brainrepresentationofacousticfeaturesduringgoalorienteddialogues
AT gravanoagustin brainrepresentationofacousticfeaturesduringgoalorienteddialogues
AT kamienkowskijuane brainrepresentationofacousticfeaturesduringgoalorienteddialogues
bdutipo_str Repositorios
_version_ 1764820458341924864