Cross-frame feature-saliency mutual reinforcing for weakly supervised video salient object detection

Jian Wang, Siyue Yu, Bingfeng Zhang, Xinqiao Zhao, Ángel F. García-Fernández, Eng Gee Lim*, Jimin Xiao

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review


Scribble annotations have recently become popular in video salient object detection. Previous methods only focus on utilizing shallow feature consistency for more integral predictions. However, there is potential for consistency between cross-frame deep features to be used to help regularize saliency predictions better. Besides, we have observed that leveraging saliency predictions as pseudo-supervision signals yields notable improvements in extracting both intra-frame and cross-frame deep features. This, in turn, leads to more precise and detailed object structural information. Thus, we propose a cross-frame feature-saliency mutual reinforcing training process to assist scribble annotations for integral video saliency predictions. Specifically, we design a cross-frame feature regularization head, which leverages intra-frame and cross-frame deep feature consistency to regularize saliency predictions as auxiliary supervision. Then, to help obtain more accurate feature consistency, we design a cross-frame saliency regularization head, where predicted saliency values are used as pseudo-supervision signals to acquire better feature consistency. In this way, our cross-frame feature and saliency regularization heads can benefit from each other to help the network learn more accurately. Extensive experiments show that our method can achieve better performances than the previous best methods. The project is available at

Original languageEnglish
Article number110302
JournalPattern Recognition
Publication statusPublished - Jun 2024


  • Cross-frame feature consistency
  • Cross-frame saliency consistency
  • Scribble annotations
  • Video salient object detection


Dive into the research topics of 'Cross-frame feature-saliency mutual reinforcing for weakly supervised video salient object detection'. Together they form a unique fingerprint.

Cite this