TY - GEN
T1 - Modeling brain-like association among focal visual objects by a bipartite mesh
AU - Yang, Jinxin
AU - Hu, Xin
AU - Zhao, Yufei
AU - Xu, Qi
AU - Yang, Wen Chi
N1 - Publisher Copyright:
©2020 IEEE
PY - 2020/9/26
Y1 - 2020/9/26
N2 - The challenge of traditional visual recognition tasks has long fallen on the segmentation of objects in two-dimensional images, whereas it is less an issue in human visual learning with the help of stereo vision and physical touches. In this kind of configuration, object classification and landmark matching are fundamentally based on the semantic similarity from inputs to conceptual prototypes in memory. Here we propose a brain-inspired cognition model that deals with visual learning tasks after the focal objects have been distinguished from their backgrounds. We designed a bipartite mesh to implement visual cognition on human faces. This mesh resolves facial landmarks into point clouds in a unique semantic space, where facial characteristics can be perceived and classified through the comparison with prototypes in the memorized ontology. These face prototypes are updatable online, and landmark matching between prototypes in the vicinity is feasible through a direct mapping between relative positions within their point clouds. Besides, the association between distant prototypes in the semantic space can be realized by a sequence of matching processes on intermediaries in memory. Our findings suggest a concise framework for simulating human visual learning mechanisms that well execute one-shot learning, online learning, and analogical reasoning, at the same time subject to certain brain-like constraints such as oblivion and lack of analogical cues between two dissimilar concepts.
AB - The challenge of traditional visual recognition tasks has long fallen on the segmentation of objects in two-dimensional images, whereas it is less an issue in human visual learning with the help of stereo vision and physical touches. In this kind of configuration, object classification and landmark matching are fundamentally based on the semantic similarity from inputs to conceptual prototypes in memory. Here we propose a brain-inspired cognition model that deals with visual learning tasks after the focal objects have been distinguished from their backgrounds. We designed a bipartite mesh to implement visual cognition on human faces. This mesh resolves facial landmarks into point clouds in a unique semantic space, where facial characteristics can be perceived and classified through the comparison with prototypes in the memorized ontology. These face prototypes are updatable online, and landmark matching between prototypes in the vicinity is feasible through a direct mapping between relative positions within their point clouds. Besides, the association between distant prototypes in the semantic space can be realized by a sequence of matching processes on intermediaries in memory. Our findings suggest a concise framework for simulating human visual learning mechanisms that well execute one-shot learning, online learning, and analogical reasoning, at the same time subject to certain brain-like constraints such as oblivion and lack of analogical cues between two dissimilar concepts.
UR - http://www.scopus.com/inward/record.url?scp=85112867503&partnerID=8YFLogxK
U2 - 10.1109/ICCICC50026.2020.09450256
DO - 10.1109/ICCICC50026.2020.09450256
M3 - Conference Proceeding
AN - SCOPUS:85112867503
T3 - Proceedings of 2020 IEEE 19th International Conference on Cognitive Informatics and Cognitive Computing, ICCI*CC 2020
SP - 150
EP - 157
BT - Proceedings of 2020 IEEE 19th International Conference on Cognitive Informatics and Cognitive Computing, ICCI*CC 2020
A2 - Wang, Yingxu
A2 - Ge, Ning
A2 - Lu, Jianhua
A2 - Tao, Xiaoming
A2 - Soda, Paolo
A2 - Howard, Newton
A2 - Widrow, Bernard
A2 - Feldman, Jerome
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 19th IEEE International Conference on Cognitive Informatics and Cognitive Computing, ICCI*CC 2020
Y2 - 26 September 2020 through 28 September 2020
ER -