Prosodic facilitation and interference while judging on the veracity of synthesized statements
Two primary sources of information are provided in human speech. On the one hand, the verbal channel encodes linguistic content, while on the other hand, the vocal channel transmits paralinguistic information, mainly through prosody. In line with several studies that induce a conflict between these...
Guardado en:
| Autores principales: | , , , , , , , , , , |
|---|---|
| Formato: | CONF |
| Materias: | |
| Acceso en línea: | http://hdl.handle.net/20.500.12110/paper_2308457X_v2017-August_n_p2331_Galvez |
| Aporte de: |
| id |
todo:paper_2308457X_v2017-August_n_p2331_Galvez |
|---|---|
| record_format |
dspace |
| spelling |
todo:paper_2308457X_v2017-August_n_p2331_Galvez2023-10-03T16:40:53Z Prosodic facilitation and interference while judging on the veracity of synthesized statements Gálvez, R.H. Benus, S. Gravano, A. Trnka, M. Lacerda F. Strombergsson S. Wlodarczak M. Heldner M. Gustafson J. House D. Amazon Alexa; Apple; DiDi; et al.; Furhat Robotics; Microsoft Entrainment Prosodic interference/facilitation Text to speech Trustworthiness Air entrainment Linguistics Speech Cognitive loads Human speech Paralinguistic information Primary sources Prosodic interference/facilitation Synthesized speech Text to speech Trustworthiness Speech communication Two primary sources of information are provided in human speech. On the one hand, the verbal channel encodes linguistic content, while on the other hand, the vocal channel transmits paralinguistic information, mainly through prosody. In line with several studies that induce a conflict between these two channels to better understand the role of prosody, we conducted an experiment in which subjects had to listen to a series of statements synthesized with varying prosody and indicate if they believed them to be true or false. We find evidence suggesting that acoustic/prosodic (a/p) features of the synthesized statements affect response times (a well-known proxy for cognitive load). Our results suggest that prosody in synthesized speech may play a role of either facilitation or interference when subjects judge the truthfulness of a statement. Furthermore, we find that this pattern is amplified when the a/p features of the synthesized statements are analyzed relative to the subjects' own a/p features. This suggests that the entrainment of TTS voices has serious implications in the perceived trustworthiness of the system's skills. Copyright © 2017 ISCA. CONF info:eu-repo/semantics/openAccess http://creativecommons.org/licenses/by/2.5/ar http://hdl.handle.net/20.500.12110/paper_2308457X_v2017-August_n_p2331_Galvez |
| institution |
Universidad de Buenos Aires |
| institution_str |
I-28 |
| repository_str |
R-134 |
| collection |
Biblioteca Digital - Facultad de Ciencias Exactas y Naturales (UBA) |
| topic |
Entrainment Prosodic interference/facilitation Text to speech Trustworthiness Air entrainment Linguistics Speech Cognitive loads Human speech Paralinguistic information Primary sources Prosodic interference/facilitation Synthesized speech Text to speech Trustworthiness Speech communication |
| spellingShingle |
Entrainment Prosodic interference/facilitation Text to speech Trustworthiness Air entrainment Linguistics Speech Cognitive loads Human speech Paralinguistic information Primary sources Prosodic interference/facilitation Synthesized speech Text to speech Trustworthiness Speech communication Gálvez, R.H. Benus, S. Gravano, A. Trnka, M. Lacerda F. Strombergsson S. Wlodarczak M. Heldner M. Gustafson J. House D. Amazon Alexa; Apple; DiDi; et al.; Furhat Robotics; Microsoft Prosodic facilitation and interference while judging on the veracity of synthesized statements |
| topic_facet |
Entrainment Prosodic interference/facilitation Text to speech Trustworthiness Air entrainment Linguistics Speech Cognitive loads Human speech Paralinguistic information Primary sources Prosodic interference/facilitation Synthesized speech Text to speech Trustworthiness Speech communication |
| description |
Two primary sources of information are provided in human speech. On the one hand, the verbal channel encodes linguistic content, while on the other hand, the vocal channel transmits paralinguistic information, mainly through prosody. In line with several studies that induce a conflict between these two channels to better understand the role of prosody, we conducted an experiment in which subjects had to listen to a series of statements synthesized with varying prosody and indicate if they believed them to be true or false. We find evidence suggesting that acoustic/prosodic (a/p) features of the synthesized statements affect response times (a well-known proxy for cognitive load). Our results suggest that prosody in synthesized speech may play a role of either facilitation or interference when subjects judge the truthfulness of a statement. Furthermore, we find that this pattern is amplified when the a/p features of the synthesized statements are analyzed relative to the subjects' own a/p features. This suggests that the entrainment of TTS voices has serious implications in the perceived trustworthiness of the system's skills. Copyright © 2017 ISCA. |
| format |
CONF |
| author |
Gálvez, R.H. Benus, S. Gravano, A. Trnka, M. Lacerda F. Strombergsson S. Wlodarczak M. Heldner M. Gustafson J. House D. Amazon Alexa; Apple; DiDi; et al.; Furhat Robotics; Microsoft |
| author_facet |
Gálvez, R.H. Benus, S. Gravano, A. Trnka, M. Lacerda F. Strombergsson S. Wlodarczak M. Heldner M. Gustafson J. House D. Amazon Alexa; Apple; DiDi; et al.; Furhat Robotics; Microsoft |
| author_sort |
Gálvez, R.H. |
| title |
Prosodic facilitation and interference while judging on the veracity of synthesized statements |
| title_short |
Prosodic facilitation and interference while judging on the veracity of synthesized statements |
| title_full |
Prosodic facilitation and interference while judging on the veracity of synthesized statements |
| title_fullStr |
Prosodic facilitation and interference while judging on the veracity of synthesized statements |
| title_full_unstemmed |
Prosodic facilitation and interference while judging on the veracity of synthesized statements |
| title_sort |
prosodic facilitation and interference while judging on the veracity of synthesized statements |
| url |
http://hdl.handle.net/20.500.12110/paper_2308457X_v2017-August_n_p2331_Galvez |
| work_keys_str_mv |
AT galvezrh prosodicfacilitationandinterferencewhilejudgingontheveracityofsynthesizedstatements AT benuss prosodicfacilitationandinterferencewhilejudgingontheveracityofsynthesizedstatements AT gravanoa prosodicfacilitationandinterferencewhilejudgingontheveracityofsynthesizedstatements AT trnkam prosodicfacilitationandinterferencewhilejudgingontheveracityofsynthesizedstatements AT lacerdaf prosodicfacilitationandinterferencewhilejudgingontheveracityofsynthesizedstatements AT strombergssons prosodicfacilitationandinterferencewhilejudgingontheveracityofsynthesizedstatements AT wlodarczakm prosodicfacilitationandinterferencewhilejudgingontheveracityofsynthesizedstatements AT heldnerm prosodicfacilitationandinterferencewhilejudgingontheveracityofsynthesizedstatements AT gustafsonj prosodicfacilitationandinterferencewhilejudgingontheveracityofsynthesizedstatements AT housed prosodicfacilitationandinterferencewhilejudgingontheveracityofsynthesizedstatements AT amazonalexaappledidietalfurhatroboticsmicrosoft prosodicfacilitationandinterferencewhilejudgingontheveracityofsynthesizedstatements |
| _version_ |
1807322545414733824 |