TY - JOUR
T1 - MambaEviScrib
T2 - Mamba and evidence-guided consistency enhance CNN robustness for scribble-based weakly supervised ultrasound image segmentation
AU - Han, Xiaoxiang
AU - Li, Xinyu
AU - Shang, Jiang
AU - Liu, Yiman
AU - Chen, Keyan
AU - Xu, Shugong
AU - Liu, Qiaohong
AU - Zhang, Qi
N1 - Publisher Copyright:
© 2025 Elsevier B.V.
PY - 2026/2
Y1 - 2026/2
N2 - Segmenting anatomical structures and lesions from ultrasound images contributes to disease assessment, diagnosis, and treatment. Weakly supervised learning (WSL) based on sparse annotation has demonstrated the potential to reduce annotation costs. This study attempts to introduce scribble-based WSL into ultrasound image segmentation tasks. However, ultrasound images often suffer from poor contrast and unclear edges, coupled with insufficient supervision for edges, posing challenges to edge prediction. Uncertainty modeling has been proven to facilitate models in handling these issues. Nevertheless, existing uncertainty estimation paradigms lack robustness and often filter out predictions near decision boundaries, resulting in unstable edge predictions. Therefore, we propose leveraging predictions near decision boundaries effectively. Specifically, we introduce Dempster-Shafer Theory (DST) of evidence to design an Evidence-Guided Consistency (EGC) strategy. This strategy utilizes high-evidence predictions, which are more likely to occur near high-density regions, to guide the optimization of low-evidence predictions that may appear near decision boundaries. Furthermore, the varying sizes and locations of lesions in ultrasound images challenge CNNs with local receptive fields, hindering global information modeling. Therefore, we introduce Visual Mamba, a structured state space model, for long-range dependency with linear complexity, and propose a hybrid CNN-Mamba framework for both local and global information fusion. During training, the collaboration between the CNN branch and the Mamba branch draws inspiration from each other based on the EGC strategy. Extensive experiments on four ultrasound public datasets for binary-class and multi-class segmentation demonstrate the competitiveness of the proposed method. The scribble-annotated dataset and code will be made available on https://github.com/GtLinyer/MambaEviScrib.
AB - Segmenting anatomical structures and lesions from ultrasound images contributes to disease assessment, diagnosis, and treatment. Weakly supervised learning (WSL) based on sparse annotation has demonstrated the potential to reduce annotation costs. This study attempts to introduce scribble-based WSL into ultrasound image segmentation tasks. However, ultrasound images often suffer from poor contrast and unclear edges, coupled with insufficient supervision for edges, posing challenges to edge prediction. Uncertainty modeling has been proven to facilitate models in handling these issues. Nevertheless, existing uncertainty estimation paradigms lack robustness and often filter out predictions near decision boundaries, resulting in unstable edge predictions. Therefore, we propose leveraging predictions near decision boundaries effectively. Specifically, we introduce Dempster-Shafer Theory (DST) of evidence to design an Evidence-Guided Consistency (EGC) strategy. This strategy utilizes high-evidence predictions, which are more likely to occur near high-density regions, to guide the optimization of low-evidence predictions that may appear near decision boundaries. Furthermore, the varying sizes and locations of lesions in ultrasound images challenge CNNs with local receptive fields, hindering global information modeling. Therefore, we introduce Visual Mamba, a structured state space model, for long-range dependency with linear complexity, and propose a hybrid CNN-Mamba framework for both local and global information fusion. During training, the collaboration between the CNN branch and the Mamba branch draws inspiration from each other based on the EGC strategy. Extensive experiments on four ultrasound public datasets for binary-class and multi-class segmentation demonstrate the competitiveness of the proposed method. The scribble-annotated dataset and code will be made available on https://github.com/GtLinyer/MambaEviScrib.
KW - Evidential deep learning
KW - Image segmentation
KW - Mamba
KW - Ultrasound
KW - Weakly supervised learning
UR - https://www.scopus.com/pages/publications/105012740058
U2 - 10.1016/j.inffus.2025.103590
DO - 10.1016/j.inffus.2025.103590
M3 - Article
AN - SCOPUS:105012740058
SN - 1566-2535
VL - 126
JO - Information Fusion
JF - Information Fusion
M1 - 103590
ER -