Implementing acoustic-prosodic entrainment in a conversational avatar

Entrainment, aka accommodation or alignment, is the phenomenon by which conversational partners become more similar to each other in behavior. While there has been much work on some behaviors there has been little on entrainment in speech and even less on how Spoken Dialogue Systems (SDS) which entr...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Levitan, R., Beňuš, Š., Gálvez, R.H., Gravano, A., Savoretti, F., Trnka, M., Weise, A., Hirschberg, J., Morgan N., Georgiou P., Narayanan S., Metze F., Amazon Alexa; Apple; eBay; et al.; Google; Microsoft
Formato: CONF
Materias:
Acceso en línea:http://hdl.handle.net/20.500.12110/paper_2308457X_v08-12-September-2016_n_p1166_Levitan
Aporte de:
id todo:paper_2308457X_v08-12-September-2016_n_p1166_Levitan
record_format dspace
spelling todo:paper_2308457X_v08-12-September-2016_n_p1166_Levitan2023-10-03T16:40:50Z Implementing acoustic-prosodic entrainment in a conversational avatar Levitan, R. Beňuš, Š. Gálvez, R.H. Gravano, A. Savoretti, F. Trnka, M. Weise, A. Hirschberg, J. Morgan N. Georgiou P. Morgan N. Narayanan S. Metze F. Amazon Alexa; Apple; eBay; et al.; Google; Microsoft Alignment Avatars Entrainment Virtual agents Air entrainment Alignment Behavioral research Speech Speech processing Avatars Spoken dialogue system Virtual agent Speech communication Entrainment, aka accommodation or alignment, is the phenomenon by which conversational partners become more similar to each other in behavior. While there has been much work on some behaviors there has been little on entrainment in speech and even less on how Spoken Dialogue Systems (SDS) which entrain to their users' speech can be created. We present an architecture and algorithm for implementing acoustic-prosodic entrainment in SDS and show that speech produced under this algorithm conforms to the feature targets, satisfying the properties of entrainment behavior observed in human-human conversations. We present results of an extrinsic evaluation of this method, comparing whether subjects are more likely to ask advice from a conversational avatar that entrains vs. one that does not, in English, Spanish and Slovak SDS. Copyright © 2016 ISCA. Fil:Gravano, A. Universidad de Buenos Aires. Facultad de Ciencias Exactas y Naturales; Argentina. CONF info:eu-repo/semantics/openAccess http://creativecommons.org/licenses/by/2.5/ar http://hdl.handle.net/20.500.12110/paper_2308457X_v08-12-September-2016_n_p1166_Levitan
institution Universidad de Buenos Aires
institution_str I-28
repository_str R-134
collection Biblioteca Digital - Facultad de Ciencias Exactas y Naturales (UBA)
topic Alignment
Avatars
Entrainment
Virtual agents
Air entrainment
Alignment
Behavioral research
Speech
Speech processing
Avatars
Spoken dialogue system
Virtual agent
Speech communication
spellingShingle Alignment
Avatars
Entrainment
Virtual agents
Air entrainment
Alignment
Behavioral research
Speech
Speech processing
Avatars
Spoken dialogue system
Virtual agent
Speech communication
Levitan, R.
Beňuš, Š.
Gálvez, R.H.
Gravano, A.
Savoretti, F.
Trnka, M.
Weise, A.
Hirschberg, J.
Morgan N.
Georgiou P.
Morgan N.
Narayanan S.
Metze F.
Amazon Alexa; Apple; eBay; et al.; Google; Microsoft
Implementing acoustic-prosodic entrainment in a conversational avatar
topic_facet Alignment
Avatars
Entrainment
Virtual agents
Air entrainment
Alignment
Behavioral research
Speech
Speech processing
Avatars
Spoken dialogue system
Virtual agent
Speech communication
description Entrainment, aka accommodation or alignment, is the phenomenon by which conversational partners become more similar to each other in behavior. While there has been much work on some behaviors there has been little on entrainment in speech and even less on how Spoken Dialogue Systems (SDS) which entrain to their users' speech can be created. We present an architecture and algorithm for implementing acoustic-prosodic entrainment in SDS and show that speech produced under this algorithm conforms to the feature targets, satisfying the properties of entrainment behavior observed in human-human conversations. We present results of an extrinsic evaluation of this method, comparing whether subjects are more likely to ask advice from a conversational avatar that entrains vs. one that does not, in English, Spanish and Slovak SDS. Copyright © 2016 ISCA.
format CONF
author Levitan, R.
Beňuš, Š.
Gálvez, R.H.
Gravano, A.
Savoretti, F.
Trnka, M.
Weise, A.
Hirschberg, J.
Morgan N.
Georgiou P.
Morgan N.
Narayanan S.
Metze F.
Amazon Alexa; Apple; eBay; et al.; Google; Microsoft
author_facet Levitan, R.
Beňuš, Š.
Gálvez, R.H.
Gravano, A.
Savoretti, F.
Trnka, M.
Weise, A.
Hirschberg, J.
Morgan N.
Georgiou P.
Morgan N.
Narayanan S.
Metze F.
Amazon Alexa; Apple; eBay; et al.; Google; Microsoft
author_sort Levitan, R.
title Implementing acoustic-prosodic entrainment in a conversational avatar
title_short Implementing acoustic-prosodic entrainment in a conversational avatar
title_full Implementing acoustic-prosodic entrainment in a conversational avatar
title_fullStr Implementing acoustic-prosodic entrainment in a conversational avatar
title_full_unstemmed Implementing acoustic-prosodic entrainment in a conversational avatar
title_sort implementing acoustic-prosodic entrainment in a conversational avatar
url http://hdl.handle.net/20.500.12110/paper_2308457X_v08-12-September-2016_n_p1166_Levitan
work_keys_str_mv AT levitanr implementingacousticprosodicentrainmentinaconversationalavatar
AT benuss implementingacousticprosodicentrainmentinaconversationalavatar
AT galvezrh implementingacousticprosodicentrainmentinaconversationalavatar
AT gravanoa implementingacousticprosodicentrainmentinaconversationalavatar
AT savorettif implementingacousticprosodicentrainmentinaconversationalavatar
AT trnkam implementingacousticprosodicentrainmentinaconversationalavatar
AT weisea implementingacousticprosodicentrainmentinaconversationalavatar
AT hirschbergj implementingacousticprosodicentrainmentinaconversationalavatar
AT morgann implementingacousticprosodicentrainmentinaconversationalavatar
AT georgioup implementingacousticprosodicentrainmentinaconversationalavatar
AT morgann implementingacousticprosodicentrainmentinaconversationalavatar
AT narayanans implementingacousticprosodicentrainmentinaconversationalavatar
AT metzef implementingacousticprosodicentrainmentinaconversationalavatar
AT amazonalexaappleebayetalgooglemicrosoft implementingacousticprosodicentrainmentinaconversationalavatar
_version_ 1782030812869296128