TY - JOUR
T1 - FuzH-PID
T2 - Highly controllable and stable DNN for COVID-19 detection via improved stochastic optimization
AU - Yao, Xujing
AU - Kang, Cheng
AU - Zhang, Xin
AU - Wang, Shuihua
AU - Zhang, Yudong
N1 - Publisher Copyright:
© 2024 The Author(s)
PY - 2025/4/5
Y1 - 2025/4/5
N2 - Amid the ongoing pandemic, reducing reliance on manual diagnostic procedures has become crucial. In this light, deep neural networks (DNNs) have demonstrated substantial progress in coronavirus disease 2019 (COVID-19) detection. However, when exposed to ‘toxic samples’—imprecise or uncertain data such as outliers, noisy or mislabeled entries, that negatively impact the training process—existing methods cannot effectively protect the training convergence from the overshoot phenomenon. This situation would slow the training convergence. Additionally, current diagnostic models necessitate substantial re-tuning time to adapt to new virus strains or to handle data from different platforms. This research focuses on the parameter updates design and propose a highly controllable and stable DNN for COVID-19 detection. By exploiting the past, current and future changes of the gradient in a fuzzy logic manner, and taking into account the cross-coupling effect between the gradient and its rate of change, we achieve dynamic, high-precision control on parameter updates in DNN optimization to reach a stable status at a faster convergence rate. In each iteration, the current learning rate adjusts itself to the current optimal value within the fuzzy neighboring region. Potentially hereditary module sequentially transfers the trained knowledge between estimators while updating the fuzzy universe range based on the calculated contraction–expansion factors. Consequently, our proposed algorithm alleviates the overshoot suffered by toxic samples, meanwhile effectively enhancing the model robustness, resource-efficiency, flexibility, adaptability, and compatibility. When tested on popular DNN architectures, it yields up to 47.18% acceleration with promising accuracy on four public datasets. Extensive experiments prove the effectiveness of our method in comparison to state-of-the-art optimizers and diagnosis systems, facilitating the real-life demands for COVID-19 detection.
AB - Amid the ongoing pandemic, reducing reliance on manual diagnostic procedures has become crucial. In this light, deep neural networks (DNNs) have demonstrated substantial progress in coronavirus disease 2019 (COVID-19) detection. However, when exposed to ‘toxic samples’—imprecise or uncertain data such as outliers, noisy or mislabeled entries, that negatively impact the training process—existing methods cannot effectively protect the training convergence from the overshoot phenomenon. This situation would slow the training convergence. Additionally, current diagnostic models necessitate substantial re-tuning time to adapt to new virus strains or to handle data from different platforms. This research focuses on the parameter updates design and propose a highly controllable and stable DNN for COVID-19 detection. By exploiting the past, current and future changes of the gradient in a fuzzy logic manner, and taking into account the cross-coupling effect between the gradient and its rate of change, we achieve dynamic, high-precision control on parameter updates in DNN optimization to reach a stable status at a faster convergence rate. In each iteration, the current learning rate adjusts itself to the current optimal value within the fuzzy neighboring region. Potentially hereditary module sequentially transfers the trained knowledge between estimators while updating the fuzzy universe range based on the calculated contraction–expansion factors. Consequently, our proposed algorithm alleviates the overshoot suffered by toxic samples, meanwhile effectively enhancing the model robustness, resource-efficiency, flexibility, adaptability, and compatibility. When tested on popular DNN architectures, it yields up to 47.18% acceleration with promising accuracy on four public datasets. Extensive experiments prove the effectiveness of our method in comparison to state-of-the-art optimizers and diagnosis systems, facilitating the real-life demands for COVID-19 detection.
KW - Convolutional neural network
KW - COVID-19
KW - Deep learning
KW - Fuzzy logic
KW - Optimization
KW - Proportional-integral-derivative control
KW - Stochastic gradient descent
UR - http://www.scopus.com/inward/record.url?scp=85213824720&partnerID=8YFLogxK
U2 - 10.1016/j.eswa.2024.126323
DO - 10.1016/j.eswa.2024.126323
M3 - Article
AN - SCOPUS:85213824720
SN - 0957-4174
VL - 268
JO - Expert Systems with Applications
JF - Expert Systems with Applications
M1 - 126323
ER -