TY - GEN
T1 - An IoMT Architecture and Reciprocity Protocol for More-Than-Human Interaction
AU - Chen, Zhonghao
AU - Lau, Kim
AU - Wheeler, William
AU - Lo, Cheng Hung
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2026.
PY - 2026
Y1 - 2026
N2 - This paper presents a methodological approach for enabling more-than-human interaction through the integration of an Internet of Multimedia Things (IoMT) architecture and a protocol-level interaction model termed the Reciprocity Protocol. While conventional environmental IoT systems prioritise low-bandwidth telemetry and representational engagement, they are poorly suited to interactions requiring temporal coherence and sustained perceptual coupling with remote ecological processes. To address this gap, we propose a dual-node IoMT architecture that supports continuous, high-fidelity audiovisual streaming alongside environmental sensing, combined with an interaction protocol that ensures human input modulates rather than overrides environmental signals. The approach is instantiated in an interactive system prototype used as an evaluation testbed. Technical probes and qualitative observations indicate that the architecture maintains low-latency feedback and that the Reciprocity Protocol reliably preserves environmental primacy, encouraging shifts from control-oriented interaction toward negotiated, temporally attuned engagement. The paper contributes a transferable interaction methodology and system blueprint for ecological and more-than-human HCI that foregrounds infrastructure and protocol design over representational interfaces.
AB - This paper presents a methodological approach for enabling more-than-human interaction through the integration of an Internet of Multimedia Things (IoMT) architecture and a protocol-level interaction model termed the Reciprocity Protocol. While conventional environmental IoT systems prioritise low-bandwidth telemetry and representational engagement, they are poorly suited to interactions requiring temporal coherence and sustained perceptual coupling with remote ecological processes. To address this gap, we propose a dual-node IoMT architecture that supports continuous, high-fidelity audiovisual streaming alongside environmental sensing, combined with an interaction protocol that ensures human input modulates rather than overrides environmental signals. The approach is instantiated in an interactive system prototype used as an evaluation testbed. Technical probes and qualitative observations indicate that the architecture maintains low-latency feedback and that the Reciprocity Protocol reliably preserves environmental primacy, encouraging shifts from control-oriented interaction toward negotiated, temporally attuned engagement. The paper contributes a transferable interaction methodology and system blueprint for ecological and more-than-human HCI that foregrounds infrastructure and protocol design over representational interfaces.
KW - Distributed Agency
KW - Ecological Interfaces
KW - Interaction Protocol
KW - Internet of Multimedia Things (IoMT)
KW - More-than-Human HCI
UR - https://www.scopus.com/pages/publications/105044950267
U2 - 10.1007/978-3-032-29897-3_13
DO - 10.1007/978-3-032-29897-3_13
M3 - Conference Proceeding
AN - SCOPUS:105044950267
SN - 9783032298966
T3 - Lecture Notes in Computer Science
SP - 215
EP - 229
BT - Cross-Cultural Design - 18th International Conference, CCD 2026, Held as Part of the 28th HCI International Conference, HCII 2026, Proceedings
A2 - Rau, Pei-Luen Patrick
PB - Springer Science and Business Media Deutschland GmbH
T2 - 18th International Conference on Cross-Cultural Design, CCD 2026, held as part of the 28th International Conference on Human-Computer Interaction, HCII 2026
Y2 - 26 July 2026 through 31 July 2026
ER -