Walking Through Shanshui: Generating Chinese Shanshui Paintings via Real-time Tracking of Human Position

Aven Le Zhou

doi:10.1109/ICCVW.2019.00395

Walking Through Shanshui: Generating Chinese Shanshui Paintings via Real-time Tracking of Human Position

Aven Le Zhou^*

^*Corresponding author for this work

artMachines

Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review

4 Citations (Scopus)

Abstract

Shanshui is a traditional East Asian style of ink brush painting that depicts natural landscapes in a semi-abstract fashion. To create a Shanshui painting, ancient Chinese scholar-artists rely heavily on their travel experiences as well as their movements in natural spaces. In this paper, we propose an interactive system - 'Walking Through Shanshui' - based on AI using Generative Adversarial Networks and various computer vision techniques. The system is an interactive art installation that helps bring the original experience of creating Shanshui to participants by tracking their movement through walking in a virtual space. It uses position tracking as input to generate Shanshui from participant's movements and to paint with a custom generative Sketch-to-Shanshui translation model. The system detects the participant's position in real-time and automatically traces it to generate a Shanshui painting instantly.

Original language	English
Title of host publication	Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	3185-3188
Number of pages	4
ISBN (Electronic)	9781728150239
DOIs	https://doi.org/10.1109/ICCVW.2019.00395
Publication status	Published - Oct 2019
Externally published	Yes
Event	17th IEEE/CVF International Conference on Computer Vision Workshop, ICCVW 2019 - Seoul, Korea, Republic of Duration: 27 Oct 2019 → 28 Oct 2019

Publication series

Name	Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019

Conference

Conference	17th IEEE/CVF International Conference on Computer Vision Workshop, ICCVW 2019
Country/Territory	Korea, Republic of
City	Seoul
Period	27/10/19 → 28/10/19

Keywords

AI art
Chinese heritage
Custom data set
Generative art
Generative machine learning
Interactive installation
Shanshui

Access to Document

10.1109/ICCVW.2019.00395

Cite this

Zhou, A. L. (2019). Walking Through Shanshui: Generating Chinese Shanshui Paintings via Real-time Tracking of Human Position. In Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019 (pp. 3185-3188). Article 9022422 (Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCVW.2019.00395

Zhou, Aven Le. / Walking Through Shanshui: Generating Chinese Shanshui Paintings via Real-time Tracking of Human Position. Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 3185-3188 (Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019).

@inproceedings{a26bf073ecbf4000b85cb1808118e07d,

title = "Walking Through Shanshui: Generating Chinese Shanshui Paintings via Real-time Tracking of Human Position",

abstract = "Shanshui is a traditional East Asian style of ink brush painting that depicts natural landscapes in a semi-abstract fashion. To create a Shanshui painting, ancient Chinese scholar-artists rely heavily on their travel experiences as well as their movements in natural spaces. In this paper, we propose an interactive system - 'Walking Through Shanshui' - based on AI using Generative Adversarial Networks and various computer vision techniques. The system is an interactive art installation that helps bring the original experience of creating Shanshui to participants by tracking their movement through walking in a virtual space. It uses position tracking as input to generate Shanshui from participant's movements and to paint with a custom generative Sketch-to-Shanshui translation model. The system detects the participant's position in real-time and automatically traces it to generate a Shanshui painting instantly.",

keywords = "AI art, Chinese heritage, Custom data set, Generative art, Generative machine learning, Interactive installation, Shanshui",

author = "Zhou, \{Aven Le\}",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 17th IEEE/CVF International Conference on Computer Vision Workshop, ICCVW 2019 ; Conference date: 27-10-2019 Through 28-10-2019",

year = "2019",

month = oct,

doi = "10.1109/ICCVW.2019.00395",

language = "English",

series = "Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "3185--3188",

booktitle = "Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019",

}

Zhou, AL 2019, Walking Through Shanshui: Generating Chinese Shanshui Paintings via Real-time Tracking of Human Position. in Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019., 9022422, Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019, Institute of Electrical and Electronics Engineers Inc., pp. 3185-3188, 17th IEEE/CVF International Conference on Computer Vision Workshop, ICCVW 2019, Seoul, Korea, Republic of, 27/10/19. https://doi.org/10.1109/ICCVW.2019.00395

Walking Through Shanshui: Generating Chinese Shanshui Paintings via Real-time Tracking of Human Position. / Zhou, Aven Le.
Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 3185-3188 9022422 (Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019).

Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review

TY - GEN

T1 - Walking Through Shanshui: Generating Chinese Shanshui Paintings via Real-time Tracking of Human Position

AU - Zhou, Aven Le

PY - 2019/10

Y1 - 2019/10

N2 - Shanshui is a traditional East Asian style of ink brush painting that depicts natural landscapes in a semi-abstract fashion. To create a Shanshui painting, ancient Chinese scholar-artists rely heavily on their travel experiences as well as their movements in natural spaces. In this paper, we propose an interactive system - 'Walking Through Shanshui' - based on AI using Generative Adversarial Networks and various computer vision techniques. The system is an interactive art installation that helps bring the original experience of creating Shanshui to participants by tracking their movement through walking in a virtual space. It uses position tracking as input to generate Shanshui from participant's movements and to paint with a custom generative Sketch-to-Shanshui translation model. The system detects the participant's position in real-time and automatically traces it to generate a Shanshui painting instantly.

AB - Shanshui is a traditional East Asian style of ink brush painting that depicts natural landscapes in a semi-abstract fashion. To create a Shanshui painting, ancient Chinese scholar-artists rely heavily on their travel experiences as well as their movements in natural spaces. In this paper, we propose an interactive system - 'Walking Through Shanshui' - based on AI using Generative Adversarial Networks and various computer vision techniques. The system is an interactive art installation that helps bring the original experience of creating Shanshui to participants by tracking their movement through walking in a virtual space. It uses position tracking as input to generate Shanshui from participant's movements and to paint with a custom generative Sketch-to-Shanshui translation model. The system detects the participant's position in real-time and automatically traces it to generate a Shanshui painting instantly.

KW - AI art

KW - Chinese heritage

KW - Custom data set

KW - Generative art

KW - Generative machine learning

KW - Interactive installation

KW - Shanshui

UR - https://www.scopus.com/pages/publications/85082487741

U2 - 10.1109/ICCVW.2019.00395

DO - 10.1109/ICCVW.2019.00395

M3 - Conference Proceeding

AN - SCOPUS:85082487741

T3 - Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019

SP - 3185

EP - 3188

BT - Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 17th IEEE/CVF International Conference on Computer Vision Workshop, ICCVW 2019

Y2 - 27 October 2019 through 28 October 2019

ER -

Zhou AL. Walking Through Shanshui: Generating Chinese Shanshui Paintings via Real-time Tracking of Human Position. In Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 3185-3188. 9022422. (Proceedings - 2019 International Conference on Computer Vision Workshop, ICCVW 2019). doi: 10.1109/ICCVW.2019.00395

Walking Through Shanshui: Generating Chinese Shanshui Paintings via Real-time Tracking of Human Position

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Shanshui Journey: Using AI to Reproduce the Experience of Chinese Literati Ink Paintings

Computer Vision Art Gallery

17th IEEE/CVF International Conference on Computer Vision, ICCV 2019

Cite this

Walking Through Shanshui: Generating Chinese Shanshui Paintings via Real-time Tracking of Human Position

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Research output

Shanshui Journey: Using AI to Reproduce the Experience of Chinese Literati Ink Paintings

Activities

Computer Vision Art Gallery

17th IEEE/CVF International Conference on Computer Vision, ICCV 2019

Cite this