TY - JOUR
T1 - A Heuristic Neural Network Structure Relying on Fuzzy Logic for Images Scoring
AU - Kang, Cheng
AU - Yu, Xiang
AU - Wang, Shui Hua
AU - Guttery, David S.
AU - Pandey, Hari Mohan
AU - Tian, Yingli
AU - Zhang, Yu Dong
N1 - Publisher Copyright:
© 1993-2012 IEEE.
PY - 2021/1
Y1 - 2021/1
N2 - Traditional deep learning methods are suboptimal in classifying ambiguity features, which often arise in noisy and hard to predict categories, especially, to distinguish semantic scoring. Semantic scoring, depending on semantic logic to implement evaluation, inevitably contains fuzzy description and misses some concepts, for example, the ambiguous relationship between normal and probably normal always presents unclear boundaries (normal - more likely normal - probably normal). Thus, human error is common when annotating images. Differing from existing methods that focus on modifying kernel structure of neural networks, this article proposes a dominant fuzzy fully connected layer (FFCL) for breast imaging reporting and data system (BI-RADS) scoring and validates the universality of this proposed structure. This proposed model aims to develop complementary properties of scoring for semantic paradigms, while constructing fuzzy rules based on analyzing human thought patterns, and to particularly reduce the influence of semantic conglutination. Specifically, this semantic-sensitive defuzzifier layer projects features occupied by relative categories into semantic space, and a fuzzy decoder modifies probabilities of the last output layer referring to the global trend. Moreover, the ambiguous semantic space between two relative categories shrinks during the learning phases, as the positive and negative growth trends of one category appearing among its relatives were considered. We first used the Euclidean distance to zoom in the distance between the real scores and the predicted scores, and then employed two sample t test method to evidence the advantage of the FFCL architecture. Extensive experimental results performed on the curated breast imaging subset of digital database of screening mammography dataset show that our FFCL structure can achieve superior performances for both triple and multiclass classification in BI-RADS scoring, outperforming the state-of-the-art methods.
AB - Traditional deep learning methods are suboptimal in classifying ambiguity features, which often arise in noisy and hard to predict categories, especially, to distinguish semantic scoring. Semantic scoring, depending on semantic logic to implement evaluation, inevitably contains fuzzy description and misses some concepts, for example, the ambiguous relationship between normal and probably normal always presents unclear boundaries (normal - more likely normal - probably normal). Thus, human error is common when annotating images. Differing from existing methods that focus on modifying kernel structure of neural networks, this article proposes a dominant fuzzy fully connected layer (FFCL) for breast imaging reporting and data system (BI-RADS) scoring and validates the universality of this proposed structure. This proposed model aims to develop complementary properties of scoring for semantic paradigms, while constructing fuzzy rules based on analyzing human thought patterns, and to particularly reduce the influence of semantic conglutination. Specifically, this semantic-sensitive defuzzifier layer projects features occupied by relative categories into semantic space, and a fuzzy decoder modifies probabilities of the last output layer referring to the global trend. Moreover, the ambiguous semantic space between two relative categories shrinks during the learning phases, as the positive and negative growth trends of one category appearing among its relatives were considered. We first used the Euclidean distance to zoom in the distance between the real scores and the predicted scores, and then employed two sample t test method to evidence the advantage of the FFCL architecture. Extensive experimental results performed on the curated breast imaging subset of digital database of screening mammography dataset show that our FFCL structure can achieve superior performances for both triple and multiclass classification in BI-RADS scoring, outperforming the state-of-the-art methods.
KW - Fuzzy deep neural networks
KW - fuzzy fully connected layer (FFCL)
KW - medical image scoring
KW - transfer learning
UR - http://www.scopus.com/inward/record.url?scp=85098872004&partnerID=8YFLogxK
U2 - 10.1109/TFUZZ.2020.2966163
DO - 10.1109/TFUZZ.2020.2966163
M3 - Article
AN - SCOPUS:85098872004
SN - 1063-6706
VL - 29
SP - 34
EP - 45
JO - IEEE Transactions on Fuzzy Systems
JF - IEEE Transactions on Fuzzy Systems
IS - 1
M1 - 8957449
ER -