Are we in sync during turn switch?

Jieyeon Woo; Liu Yang; Catherine Achard; Catherine Pelachaud

doi:10.1109/FG57933.2023.10042799

Are we in sync during turn switch?

Jieyeon Woo^*, Liu Yang^*, Catherine Achard, Catherine Pelachaud

^*Corresponding author for this work

University Pierre and Marie Curie (Paris 6)

Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review

Abstract

During an interaction, people exchange speaking turns by coordinating with their partners. Exchanges can be done smoothly, with pauses between turns or through interruptions. Previous studies have analyzed various modalities to investigate turn shifts and their types (smooth turn exchange, overlap, and interruption). Modality analyses were also done to study the interpersonal synchronization which is observed throughout the whole interaction. Likewise, we intend to analyze different modalities to find a relationship between the different turn switch types and interpersonal synchrony. In this study, we provide an analysis of multimodal features, focusing on prosodic features (F0 and loudness), head activity, and facial action units, to characterize different switch types.

Original language	English
Title of host publication	2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition, FG 2023
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9798350345445
DOIs	https://doi.org/10.1109/FG57933.2023.10042799
Publication status	Published - 2023
Externally published	Yes
Event	17th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2023 - Waikoloa Beach, United States Duration: 5 Jan 2023 → 8 Jan 2023

Publication series

Name	2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition, FG 2023

Conference

Conference	17th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2023
Country/Territory	United States
City	Waikoloa Beach
Period	5/01/23 → 8/01/23

Access to Document

10.1109/FG57933.2023.10042799

Cite this

Woo, J., Yang, L., Achard, C., & Pelachaud, C. (2023). Are we in sync during turn switch? In 2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition, FG 2023 (2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition, FG 2023). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FG57933.2023.10042799

@inproceedings{7b7a871ca5e9494fa3d340b22ebcf97c,

title = "Are we in sync during turn switch?",

abstract = "During an interaction, people exchange speaking turns by coordinating with their partners. Exchanges can be done smoothly, with pauses between turns or through interruptions. Previous studies have analyzed various modalities to investigate turn shifts and their types (smooth turn exchange, overlap, and interruption). Modality analyses were also done to study the interpersonal synchronization which is observed throughout the whole interaction. Likewise, we intend to analyze different modalities to find a relationship between the different turn switch types and interpersonal synchrony. In this study, we provide an analysis of multimodal features, focusing on prosodic features (F0 and loudness), head activity, and facial action units, to characterize different switch types.",

author = "Jieyeon Woo and Liu Yang and Catherine Achard and Catherine Pelachaud",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 17th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2023 ; Conference date: 05-01-2023 Through 08-01-2023",

year = "2023",

doi = "10.1109/FG57933.2023.10042799",

language = "English",

series = "2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition, FG 2023",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition, FG 2023",

}

Woo, J, Yang, L, Achard, C & Pelachaud, C 2023, Are we in sync during turn switch? in 2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition, FG 2023. 2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition, FG 2023, Institute of Electrical and Electronics Engineers Inc., 17th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2023, Waikoloa Beach, United States, 5/01/23. https://doi.org/10.1109/FG57933.2023.10042799

Are we in sync during turn switch? / Woo, Jieyeon; Yang, Liu; Achard, Catherine et al.
2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition, FG 2023. Institute of Electrical and Electronics Engineers Inc., 2023. (2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition, FG 2023).

Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review