Abstract—We describe a framework to automatically separate malignant from benign breast lesions using limited breast ultrasound data. The main uniqueness of this framework includes: (1) in terms of the unique shape features of breast lesions, two types of image patches are designed to fine-tune pre-trained models, aiming to characterize the overall appearance and heterogeneity in shapes of breast lesions. (2) taking the BI-RADS regression task as an auxiliary task, a multi-task architecture is proposed to improve the accuracy of classification. (3) instead of prevalent cross-entropy loss, we introduce training with confusion by means of regularizing prediction entropy to prevent overfitting. Extensive experimental results on small-scale breast ultrasound dataset corroborate that the proposed framework is superior to the state-of-the-art approaches in breast lesions classification with limited data. Besides, we provide detailed analysis of the choice of regularizing parameter and visual evidence that introduction of confusion leads to increase in feature generalization.

Index Terms—Breast ultrasound classification, multi-task learning, regularizing prediction entropy, transfer learning.

Jialin Shi, Ji Wu, Ping Lv are with Department of Electrical Engineering, Tsinghua University, Beijing, China (email: shi-jl16@mails.tsinghua.edu.cn).
Jiajia Guo is with The people’s Hospital of Peking University, Beijing, China.

Cite: Jialin Shi, Ji Wu, Ping Lv, Jiajia Guo, "BreastNet: Entropy-Regularized Transferable Multi-task Learning for Classification with Limited Breast Data," International Journal of Bioscience, Biochemistry and Bioinformatics vol. 9, no. 1, pp. 20-26, 2019.