Skip to main navigation Skip to search Skip to main content

SPU-PMD: Self-Supervised Point Cloud Upsampling via Progressive Mesh Deformation

  • Yanzhe Liu
  • , Rong Chen*
  • , Yushi Li*
  • , Yixi Li
  • , Xuehou Tan
  • *Corresponding author for this work
    • Dalian Maritime University
    • Tokai University

    Research output: Chapter in Book or Report/Conference proceeding › Conference Proceeding › peer-review

    22 Citations (Scopus)

    Abstract

    Despite the success of recent upsampling approaches, generating high-resolution point sets with uniform distribution and meticulous structures is still challenging. Unlike existing methods that only take spatial information of the raw data into account, we regard point cloud upsampling as generating dense point clouds from deformable topology. Motivated by this, we present SPU-PMD, a self-supervised topological mesh deformation network, for 3D densification. As a cascaded framework, our architecture is formu-lated by a series of coarse mesh interpolator and mesh de-formers. At each stage, the mesh interpolator first produces the initial dense point clouds via mesh interpolation, which allows the model to perceive the primitive topology better. Meanwhile, the deformer infers the morphing by estimating the movements of mesh nodes and reconstructs the de-scriptive topology structure. By associating mesh deformation with feature expansion, this module progressively re-fines point clouds' surface uniformity and structural details. To demonstrate the effectiveness of the proposed method, extensive quantitative and qualitative experiments are con-ducted on synthetic and real-scanned 3D data. Also, we compare it with state-of-the-art techniques to further illus-trate the superiority of our network. The project page is: https://github.com/lyz21/spU-PMd.

    Original languageEnglish
    Title of host publicationProceedings - 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024
    PublisherIEEE Computer Society
    Pages5188-5197
    Number of pages10
    ISBN (Electronic)9798350353006
    DOIs
    Publication statusPublished - 2024
    Event2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024 - Seattle, United States
    Duration: 16 Jun 2024 → 22 Jun 2024

    Publication series

    NameProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
    ISSN (Print)1063-6919

    Conference

    Conference2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2024
    Country/TerritoryUnited States
    CitySeattle
    Period16/06/24 → 22/06/24

    Keywords

    • mesh deformation
    • mesh interpolation
    • Point cloud upsampling
    • self-supervised learning
    • transformer

    Fingerprint

    Dive into the research topics of 'SPU-PMD: Self-Supervised Point Cloud Upsampling via Progressive Mesh Deformation'. Together they form a unique fingerprint.

    Cite this