Towards IMACA: Intelligent multimodal affective conversational agent

Amir Hussain; Erik Cambria; Thomas Mazzocco; Marco Grassi; Qiu Feng Wang; Tariq Durrani

doi:10.1007/978-3-642-34475-6_79

Towards IMACA: Intelligent multimodal affective conversational agent

Amir Hussain^*
, Erik Cambria
, Thomas Mazzocco
, Marco Grassi
, Qiu Feng Wang
, Tariq Durrani

^*Corresponding author for this work

University of Stirling
National University of Singapore
Marche Polytechnic University
CAS - Institute of Automation
University of Strathclyde

Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review

3 Citations (Scopus)

Abstract

A key aspect when trying to achieve natural interaction in machines is multimodality. Besides verbal communication, in fact, humans interact also through many other channels, e.g., facial expressions, gestures, eye contact, posture, and voice tone. Such channels convey not only semantics, but also emotional cues that are essential for interpreting the message transmitted. The importance of the affective information and the capability of properly managing it, in fact, has been more and more understood as fundamental for the development of a new generation of emotion-aware applications for several scenarios like e-learning, e-health, and human-computer interaction. To this end, this work investigates the adoption of different paradigms in the fields of text, vocal, and video analysis, in order to lay the basis for the development of an intelligent multimodal affective conversational agent.

Original language	English
Title of host publication	Neural Information Processing - 19th International Conference, ICONIP 2012, Proceedings
Pages	656-663
Number of pages	8
Edition	PART 1
DOIs	https://doi.org/10.1007/978-3-642-34475-6_79
Publication status	Published - 2012
Externally published	Yes
Event	19th International Conference on Neural Information Processing, ICONIP 2012 - Doha, Qatar Duration: 12 Nov 2012 → 15 Nov 2012

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 1
Volume	7663 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	19th International Conference on Neural Information Processing, ICONIP 2012
Country/Territory	Qatar
City	Doha
Period	12/11/12 → 15/11/12

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 3 Good Health and Well-being

Keywords

AI
HCI
Multimodal Sentiment Analysis

Access to Document

10.1007/978-3-642-34475-6_79

Cite this

Hussain, A., Cambria, E., Mazzocco, T., Grassi, M., Wang, Q. F., & Durrani, T. (2012). Towards IMACA: Intelligent multimodal affective conversational agent. In Neural Information Processing - 19th International Conference, ICONIP 2012, Proceedings (PART 1 ed., pp. 656-663). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7663 LNCS, No. PART 1). https://doi.org/10.1007/978-3-642-34475-6_79

Hussain, Amir ; Cambria, Erik ; Mazzocco, Thomas et al. / Towards IMACA : Intelligent multimodal affective conversational agent. Neural Information Processing - 19th International Conference, ICONIP 2012, Proceedings. PART 1. ed. 2012. pp. 656-663 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1).

@inproceedings{00de6664c4184fa7a079b1ab498dd3fc,

title = "Towards IMACA: Intelligent multimodal affective conversational agent",

abstract = "A key aspect when trying to achieve natural interaction in machines is multimodality. Besides verbal communication, in fact, humans interact also through many other channels, e.g., facial expressions, gestures, eye contact, posture, and voice tone. Such channels convey not only semantics, but also emotional cues that are essential for interpreting the message transmitted. The importance of the affective information and the capability of properly managing it, in fact, has been more and more understood as fundamental for the development of a new generation of emotion-aware applications for several scenarios like e-learning, e-health, and human-computer interaction. To this end, this work investigates the adoption of different paradigms in the fields of text, vocal, and video analysis, in order to lay the basis for the development of an intelligent multimodal affective conversational agent.",

keywords = "AI, HCI, Multimodal Sentiment Analysis",

author = "Amir Hussain and Erik Cambria and Thomas Mazzocco and Marco Grassi and Wang, \{Qiu Feng\} and Tariq Durrani",

year = "2012",

doi = "10.1007/978-3-642-34475-6\_79",

language = "English",

isbn = "9783642344749",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

number = "PART 1",

pages = "656--663",

booktitle = "Neural Information Processing - 19th International Conference, ICONIP 2012, Proceedings",

edition = "PART 1",

note = "19th International Conference on Neural Information Processing, ICONIP 2012 ; Conference date: 12-11-2012 Through 15-11-2012",

}

Hussain, A, Cambria, E, Mazzocco, T, Grassi, M, Wang, QF & Durrani, T 2012, Towards IMACA: Intelligent multimodal affective conversational agent. in Neural Information Processing - 19th International Conference, ICONIP 2012, Proceedings. PART 1 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 1, vol. 7663 LNCS, pp. 656-663, 19th International Conference on Neural Information Processing, ICONIP 2012, Doha, Qatar, 12/11/12. https://doi.org/10.1007/978-3-642-34475-6_79

Towards IMACA: Intelligent multimodal affective conversational agent. / Hussain, Amir; Cambria, Erik; Mazzocco, Thomas et al.
Neural Information Processing - 19th International Conference, ICONIP 2012, Proceedings. PART 1. ed. 2012. p. 656-663 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7663 LNCS, No. PART 1).

Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review

TY - GEN

T1 - Towards IMACA

T2 - 19th International Conference on Neural Information Processing, ICONIP 2012

AU - Hussain, Amir

AU - Cambria, Erik

AU - Mazzocco, Thomas

AU - Grassi, Marco

AU - Wang, Qiu Feng

AU - Durrani, Tariq

PY - 2012

Y1 - 2012

N2 - A key aspect when trying to achieve natural interaction in machines is multimodality. Besides verbal communication, in fact, humans interact also through many other channels, e.g., facial expressions, gestures, eye contact, posture, and voice tone. Such channels convey not only semantics, but also emotional cues that are essential for interpreting the message transmitted. The importance of the affective information and the capability of properly managing it, in fact, has been more and more understood as fundamental for the development of a new generation of emotion-aware applications for several scenarios like e-learning, e-health, and human-computer interaction. To this end, this work investigates the adoption of different paradigms in the fields of text, vocal, and video analysis, in order to lay the basis for the development of an intelligent multimodal affective conversational agent.

AB - A key aspect when trying to achieve natural interaction in machines is multimodality. Besides verbal communication, in fact, humans interact also through many other channels, e.g., facial expressions, gestures, eye contact, posture, and voice tone. Such channels convey not only semantics, but also emotional cues that are essential for interpreting the message transmitted. The importance of the affective information and the capability of properly managing it, in fact, has been more and more understood as fundamental for the development of a new generation of emotion-aware applications for several scenarios like e-learning, e-health, and human-computer interaction. To this end, this work investigates the adoption of different paradigms in the fields of text, vocal, and video analysis, in order to lay the basis for the development of an intelligent multimodal affective conversational agent.

KW - AI

KW - HCI

KW - Multimodal Sentiment Analysis

UR - https://www.scopus.com/pages/publications/84869073611

U2 - 10.1007/978-3-642-34475-6_79

DO - 10.1007/978-3-642-34475-6_79

M3 - Conference Proceeding

AN - SCOPUS:84869073611

SN - 9783642344749

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 656

EP - 663

BT - Neural Information Processing - 19th International Conference, ICONIP 2012, Proceedings

Y2 - 12 November 2012 through 15 November 2012

ER -

Hussain A, Cambria E, Mazzocco T, Grassi M, Wang QF, Durrani T. Towards IMACA: Intelligent multimodal affective conversational agent. In Neural Information Processing - 19th International Conference, ICONIP 2012, Proceedings. PART 1 ed. 2012. p. 656-663. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1). doi: 10.1007/978-3-642-34475-6_79

Towards IMACA: Intelligent multimodal affective conversational agent

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this