SmartShots: Enabling Automatic Generation of Videos with Data Visualizations Embedded

Tan Tang; Junxiu Tang; Jiewen Lai; Lu Ying; Peiran Ren; Lingyun Yu; Yingcai Wu

doi:10.1145/3394171.3414356

SmartShots: Enabling Automatic Generation of Videos with Data Visualizations Embedded

Tan Tang
, Junxiu Tang
, Jiewen Lai
, Lu Ying
, Peiran Ren
, Lingyun Yu
, Yingcai Wu^*

^*Corresponding author for this work

Department of Computing

Zhejiang University
University of California at Berkeley
Georgia Institute of Technology
Alibaba Group Holding Ltd.

Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review

3 Citations (Scopus)

Abstract

Videos become prevalent for storytellers to inspire viewers' interests. To further enhance narrations, visualizations are integrated into videos to present data-driven insights. However, manually crafting such data-driven videos is difficult and time-consuming. Thus, we present SmartShots, a system that facilitates the automatic integration of in-video visualizations. Specifically, we propose a computational framework that integrates non-verbal video clips, images, a melody, and a data table to create a video with data visualizations embedded. The system automatically translates the multi-media material into shots and then combines the shots into a compelling video. In addition, we develop a set of post-editing interactions to incorporate users' design knowledge and help them re-edit the automatically-generated videos.

Original language	English
Title of host publication	Proceedings of the 28th ACM International Conference on Multimedia
Pages	4509-4511
Number of pages	3
DOIs	https://doi.org/10.1145/3394171.3414356
Publication status	Published - 12 Oct 2020
Event	28th ACM International Conference on Multimedia, MM 2020 - Virtual, Online, United States Duration: 12 Oct 2020 → 16 Oct 2020

Conference

Conference	28th ACM International Conference on Multimedia, MM 2020
Country/Territory	United States
City	Virtual, Online
Period	12/10/20 → 16/10/20

Keywords

data-driven videos
storytelling
visualization

Access to Document

10.1145/3394171.3414356

Cite this

@inproceedings{bb8d5a48ea4e40bb8d0f8f082950b493,

title = "SmartShots: Enabling Automatic Generation of Videos with Data Visualizations Embedded",

abstract = "Videos become prevalent for storytellers to inspire viewers' interests. To further enhance narrations, visualizations are integrated into videos to present data-driven insights. However, manually crafting such data-driven videos is difficult and time-consuming. Thus, we present SmartShots, a system that facilitates the automatic integration of in-video visualizations. Specifically, we propose a computational framework that integrates non-verbal video clips, images, a melody, and a data table to create a video with data visualizations embedded. The system automatically translates the multi-media material into shots and then combines the shots into a compelling video. In addition, we develop a set of post-editing interactions to incorporate users' design knowledge and help them re-edit the automatically-generated videos.",

keywords = "data-driven videos, storytelling, visualization",

author = "Tan Tang and Junxiu Tang and Jiewen Lai and Lu Ying and Peiran Ren and Lingyun Yu and Yingcai Wu",

note = "Publisher Copyright: {\textcopyright} 2020 Owner/Author.; 28th ACM International Conference on Multimedia, MM 2020 ; Conference date: 12-10-2020 Through 16-10-2020",

year = "2020",

month = oct,

day = "12",

doi = "10.1145/3394171.3414356",

language = "English",

pages = "4509--4511",

booktitle = "Proceedings of the 28th ACM International Conference on Multimedia",

}

Tang, T, Tang, J, Lai, J, Ying, L, Ren, P, Yu, L & Wu, Y 2020, SmartShots: Enabling Automatic Generation of Videos with Data Visualizations Embedded. in Proceedings of the 28th ACM International Conference on Multimedia. pp. 4509-4511, 28th ACM International Conference on Multimedia, MM 2020, Virtual, Online, United States, 12/10/20. https://doi.org/10.1145/3394171.3414356

TY - GEN

T1 - SmartShots

T2 - 28th ACM International Conference on Multimedia, MM 2020

AU - Tang, Tan

AU - Tang, Junxiu

AU - Lai, Jiewen

AU - Ying, Lu

AU - Ren, Peiran

AU - Yu, Lingyun

AU - Wu, Yingcai

PY - 2020/10/12

Y1 - 2020/10/12

N2 - Videos become prevalent for storytellers to inspire viewers' interests. To further enhance narrations, visualizations are integrated into videos to present data-driven insights. However, manually crafting such data-driven videos is difficult and time-consuming. Thus, we present SmartShots, a system that facilitates the automatic integration of in-video visualizations. Specifically, we propose a computational framework that integrates non-verbal video clips, images, a melody, and a data table to create a video with data visualizations embedded. The system automatically translates the multi-media material into shots and then combines the shots into a compelling video. In addition, we develop a set of post-editing interactions to incorporate users' design knowledge and help them re-edit the automatically-generated videos.

AB - Videos become prevalent for storytellers to inspire viewers' interests. To further enhance narrations, visualizations are integrated into videos to present data-driven insights. However, manually crafting such data-driven videos is difficult and time-consuming. Thus, we present SmartShots, a system that facilitates the automatic integration of in-video visualizations. Specifically, we propose a computational framework that integrates non-verbal video clips, images, a melody, and a data table to create a video with data visualizations embedded. The system automatically translates the multi-media material into shots and then combines the shots into a compelling video. In addition, we develop a set of post-editing interactions to incorporate users' design knowledge and help them re-edit the automatically-generated videos.

KW - data-driven videos

KW - storytelling

KW - visualization

UR - https://www.scopus.com/pages/publications/85106962256

U2 - 10.1145/3394171.3414356

DO - 10.1145/3394171.3414356

M3 - Conference Proceeding

AN - SCOPUS:85106962256

SP - 4509

EP - 4511

BT - Proceedings of the 28th ACM International Conference on Multimedia

Y2 - 12 October 2020 through 16 October 2020

ER -

SmartShots: Enabling Automatic Generation of Videos with Data Visualizations Embedded

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this