PointGS: Bridging and fusing geometric and semantic space for 3D point cloud analysis

Chenru Jiang, Kaizhu Huang*, Junwei Wu, Xinheng Wang, Jimin Xiao, Amir Hussain

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

6 Citations (Scopus)

Abstract

Directly processing 3D point cloud data becomes dominant in classification and segmentation tasks. Present mainstream point based methods usually focus on learning in either geometric space (i.e. PointNet++) or semantic space (i.e. DGCNN). Owing to the irregular and unordered data property of point cloud, these methods still suffer from drawbacks of either ambiguous local features aggregation in geometric space or poor global features extraction in semantic space. While few prior works address these two defects simultaneously by fusing information from the dual spaces, we make a first attempt to develop a synergistic framework, called PointGS. Leveraging both the strength of geometric structure and semantic representation, PointGS establishes a mutual supervision mechanism that can bridge the two spaces and fuse complementary information for better analyzing 3D point cloud data. Compared with existing popular networks, our work attains obvious performance improvement on all three mainstream tasks without any sophisticated operations.

Original languageEnglish
Pages (from-to)316-326
Number of pages11
JournalInformation Fusion
Volume91
DOIs
Publication statusPublished - Mar 2023

Keywords

  • Geometric space learning
  • Information fusion
  • Point cloud
  • Semantic space learning

Fingerprint

Dive into the research topics of 'PointGS: Bridging and fusing geometric and semantic space for 3D point cloud analysis'. Together they form a unique fingerprint.

Cite this