×

zbMATH — the first resource for mathematics

Robust method for semantic segmentation of whole-slide blood cell microscopic images. (English) Zbl 1431.92098
Summary: Previous works on segmentation of SEM (scanning electron microscope) blood cell image ignore the semantic segmentation approach of whole-slide blood cell segmentation. In the proposed work, we address the problem of whole-slide blood cell segmentation using the semantic segmentation approach. We design a novel convolutional encoder-decoder framework along with VGG-16 as the pixel-level feature extraction model. The proposed framework comprises 3 main steps: First, all the original images along with manually generated ground truth masks of each blood cell type are passed through the preprocessing stage. In the preprocessing stage, pixel-level labeling, RGB to grayscale conversion of masked image and pixel fusing, and unity mask generation are performed. After that, VGG16 is loaded into the system, which acts as a pretrained pixel-level feature extraction model. In the third step, the training process is initiated on the proposed model. We have evaluated our network performance on three evaluation metrics. We obtained outstanding results with respect to classwise, as well as global and mean accuracies. Our system achieved classwise accuracies of 97.45%, 93.34%, and 85.11% for RBCs, WBCs, and platelets, respectively, while global and mean accuracies remain 97.18% and 91.96%, respectively.
MSC:
92C55 Biomedical imaging and signal processing
PDF BibTeX XML Cite
Full Text: DOI
References:
[1] Kihm, A.; Kaestner, L.; Wagner, C.; Quint, S., Classification of red blood cell shapes in flow using outlier tolerant machine learning, PLOS Computational Biology, 14, 6 (2018)
[2] Vinod, V., Blood cell image segmentation and counting, International Journal of Engineering Science and. Technology, 3, 3, 2448-2453 (2011)
[3] Salem, N.; Sobhy, N. M.; El Dosoky, M., A comparative study of white blood cells segmentation using Otsu threshold and Watershed transformation, Journal of Biomedical Engineering and Medical Imaging, 3, 3, 15 (2016)
[4] Nikitaev, V. G.; Nagornov, O. V.; Pronichev, A. N., Research of the leukocytes segmentation method in the blood cells recognition systems, KnE Energy, 3, 2, 350-354 (2018)
[5] Miao, H.; Xiao, C., Simultaneous segmentation of leukocyte and erythrocyte in microscopic images using a marker-controlled watershed algorithm, Computational and Mathematical Methods in Medicine, 2018 (2018) · Zbl 1411.92165
[6] Shirazi, S. H.; Umar, A. I.; Naz, S.; Haq, N., Efficient enhancement and segmentation of leukocytes from microscopic images, Journal of Applied Environmental and Biological Sciences, 6, 35, 121-126 (2016)
[7] Sajjad, M.; Khan, S.; Jan, Z., Leukocytes classification and segmentation in microscopic blood smear: a resource-aware healthcare service in smart cities, IEEE Access, 5, 3475-3489 (2017)
[8] Tian, Z.; Shen, C.; He, T.; Yan, Y., Decoders matter for semantic segmentation: data-dependent decoding enables flexible feature aggregation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
[9] Long, J.; Shelhamer, E.; Darrell, T., Fully convolutional networks for semantic segmentation, Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
[10] Simonyan, K.; Zisserman, A., Very deep convolutional networks for large-scale image recognition, https://arxiv.org/abs/1409.1556
[11] Liang, G.; Hong, H.; Xie, W.; Zheng, L., Combining convolutional neural network with recursive neural network for blood cell image classification, IEEE Access, 6, 36188-36197 (2018)
[12] Labati, R. D.; Piuri, V.; Scotti, F., All-IDB: the acute lymphoblastic leukemia image database for image processing, Proceedings of the International Conference on Image Processing, ICIP
[13] Shirazi, S. H.; Naz, S.; Razzak, M. I.; Umar, A. I.; Zaib, A., Automated pathology image analysis, Soft Computing Based Medical Image Analysis, 13-29 (2018), Amsterdam, Netherlands: Elsevier Inc., Amsterdam, Netherlands
[14] Quiñones, V. V.; Macawile, M. J.; Ballado, A.; Dela Cruz, J.; Caya, M. V., Leukocyte segmentation and counting based on microscopic blood images using HSV saturation component with blob analysis, Proceedings of the 2018 3rd International Conference on Control and Robotics Engineering (ICCRE)
[15] Shahin, A. I.; Guo, Y.; Amin, K. M.; Sharawi, A. A., A novel white blood cells segmentation algorithm based on adaptive neutrosophic similarity score, Health Information Science and Systems, 6, 1, 1 (2018)
[16] Liu, Z.; Liu, J.; Xiao, X., Segmentation of white blood cells through nucleus mark watershed operations and mean shift clustering, Sensors, 15, 9, 22561-22586 (2015)
[17] Chen, C.; Dou, Q.; Chen, H.; Qin, J.; Heng, P.-A., Synergistic image and feature adaptation: towards cross-modality domain adaptation for medical image segmentation, Proceedings of the AAAI Conference on Artificial Intelligence, 33, 865-872 (2019)
[18] Stuller, J., Ordered modified Gram-Schmidt orthogonalization revised, Journal of Computational and Applied Mathematics, 63, 1-3, 221-227 (1995) · Zbl 0856.65043
[19] Cao, H.; Liu, H.; Song, E., A novel algorithm for segmentation of leukocytes in peripheral blood, Biomedical Signal Processing and Control, 45, 10-21 (2018)
[20] Di Ruberto, C.; Loddo, A.; Putzu, L., A leucocytes count system from blood smear images, Machine Vision and Applications, 27, 8, 1151-1160 (2016)
[21] Fradkin, D.; Muchnik, I.; Fradkin, D.; Muchnik, I., Support Vector Machines for Classification, 1-9 (2000), New York, NY, USA: Springer, New York, NY, USA
[22] Yi, F.; Moon, I.; Javidi, B., Cell morphology-based classification of red blood cells using holographic imaging informatics, Biomedical Optics Express, 7, 6, 2385 (2016)
[23] Roerdink, J., The watershed transform: definitions, algorithms and parallelization strategies, Fundamenta Informaticae, 41, 1, 2, 187-228 (2001)
[24] Das, D. K.; Maiti, A. K.; Chakraborty, C., Automated identification of normoblast cell from human peripheral blood smear images, Journal of Microscopy, 269, 3, 310-320 (2018)
[25] Shirazi, S. H.; Umar, A. I.; Naz, S.; Imran, N. H. M.; Ahmad, R., Extreme learning machine based microscopic red blood cells classification, Cluster Computing, 21, 1, 691-701 (2017)
[26] Hegde, R. B.; Prasad, K.; Hebbar, H.; Singh, B. M. K., Development of a robust algorithm for detection of nuclei and classification of white blood cells in peripheral blood smear images, Journal of Medical Systems, 42, 6, 1-8 (2018)
[27] Rahman, A.; Wang, Y., Optimizing intersection-over-union in deep neural networks for image segmentation, Proceedings of the International Symposium on Visual Computing, Springer
[28] Csurka, G.; Larlus, D., What is a good evaluation measure for semantic segmentation?, Proceedings of the British Machine Vision Conference
[29] Mohammed, E. A.; Mohamed, M. M. A.; Naugler, C.; Far, B. H., Toward leveraging big value from data: chronic lymphocytic leukemia cell classification, Network Modeling Analysis in Health Informatics and Bioinformatics, 6, 1 (2017)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.