Implicit Image-to-Image Schrödinger Bridge for image restoration

Yuang Wang, Siyeop Yoon, Pengfei Jin, Matthew Tivnan, Sifan Song, Zhennong Chen, Rui Hu, Li Zhang, Quanzheng Li, Zhiqiang Chen, Dufan Wu*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Diffusion-based models have demonstrated remarkable effectiveness in image restoration tasks; however, their iterative denoising process, which starts from Gaussian noise, often leads to slow inference speeds. The Image-to-Image Schrödinger Bridge (I2SB) offers a promising alternative by initializing the generative process from corrupted images while leveraging training techniques from score-based diffusion models. In this paper, we introduce the Implicit Image-to-Image Schrödinger Bridge (I3SB) to further accelerate the generative process of I2SB. I3SB restructures the generative process into a non-Markovian framework by incorporating the initial corrupted image at each generative step, effectively preserving and utilizing its information. To enable direct use of pretrained I2SB models without additional training, we ensure consistency in marginal distributions. Extensive experiments across many image corruptions—including noise, low resolution, JPEG compression, and sparse sampling—and multiple image modalities—such as natural, human face, and medical images— demonstrate the acceleration benefits of I3SB. Compared to I2SB, I3SB achieves the same perceptual quality with fewer generative steps, while maintaining or improving fidelity to the ground truth.

Original languageEnglish
Article number111627
JournalPattern Recognition
Volume165
DOIs
Publication statusPublished - Sept 2025
Externally publishedYes

Keywords

  • Diffusion model
  • Image restoration
  • Schrödinger Bridge

Fingerprint

Dive into the research topics of 'Implicit Image-to-Image Schrödinger Bridge for image restoration'. Together they form a unique fingerprint.

Cite this