zbMATH — the first resource for mathematics

Large-deformation image registration of CT-TEE for surgical navigation of congenital heart disease. (English) Zbl 1431.92084
Summary: The surgical treatment of congenital heart disease requires navigational assistance with transesophageal echocardiography (TEE); however, TEE images are often difficult to interpret and provide very limited anatomical information. Registering preoperative CT images to intraoperative TEE images provides surgeons with richer and more useful anatomical information. Yet, CT and TEE images differ substantially in terms of scale and geometry. In the present research, we propose a novel method for the registration of CT and TEE images for navigation during surgical repair of large defects in patients with congenital heart disease. Valve data was used for the coarse registration to determine the basic location. This was followed by the use of an enhanced probability model map to overcome gray-level differences between the two imaging modalities. Finally, the rapid optimization of mutual information was achieved by migrating parameters. This method was tested on a dataset of 240 images from 12 infant, children (\(\leq 3\) years old), and adult patients with congenital heart disease. Compared to the “bronze standard” registration, the proposed method was more accurate with an average Dice coefficient of 0.91 and an average root mean square of target registration error of 1.2655 mm.
92C55 Biomedical imaging and signal processing
92C50 Medical applications (general)
Full Text: DOI
[1] Manjunath, B. S.; Shekhar, C.; Chellappa, R., A new approach to image feature detection with applications, Pattern Recognition, 29, 4, 627-640, (1996)
[2] Fonseca, L. M. G.; Costa, M. H. M., Automatic registration of satellite images, Proceedings of the 1997 10th Brazilian Symposium of Computer Graphic and Image Processing, SIBGRAPI 97
[3] Feng, Y.; Schlichting, A.; Brenner, C., 3D Feature point extraction from lidar data using a neural network, International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives 41, XLI-B1, 563-569, (2016)
[4] Cheng, Y.; Dubois, T., Object Recognition by Using Multi-level Feature Point Extraction, Computer Vision and Pattern Recognition, (2017)
[5] Chen, W. Y.; Pan, T. F.; Chen, L. G., A spatial first 3-D XYT feature point extraction algorithm for efficient human action recognition, Proceedings of the 2014 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW)
[6] Dán, G.; Khan, M. A.; Fodor, V., Characterization of SURF and brisk interest point distribution for distributed feature extraction in visual sensor networks, IEEE Transactions on Multimedia, 17, 5, 591-602, (2015)
[7] Wang, Z.; Zhang, L.; Fang, T.; Mathiopoulos, P. T.; Tong, X.; Qu, H.; Xiao, Z.; Li, F.; Chen, D., A multiscale and hierarchical feature extraction method for terrestrial laser scanning point cloud classification, IEEE Transactions on Geoscience and Remote Sensing, 53, 5, 2409-2425, (2015)
[8] Hoh, C. K.; Dahlbom, M.; Harris, G.; Choi, Y.; Hawkins, R. A.; Phelps, M. E.; Maddahi, J., Automated iterative three-dimensional registration of positron emission tomography images, Journal of Nuclear Medicine, 34, 11, 2009-2018, (1993)
[9] Lemieux, L.; Thomas, D. G. T., A patient-to-computed-tomography image registration method based on digitally reconstructed radiographs, Medical Physics, 21, 11, 1749-1760, (1994)
[10] Viola, P.; Wells, W., Alignment by maximization of mutual information, Proceedings of the 5th IEEE International Conference on Computer Vision
[11] Maes, F.; Collignon, A.; Vandermeulen, D.; Marchal, G.; Suetens, P., Multimodality image registration by maximization of mutual information, IEEE Transactions on Medical Imaging, 16, 2, 187-198, (1997)
[12] Pluim, J. P. W.; Maintz, J. B. A.; Viergever, M. A., Image registration by maximization of combined mutual information and gradient information, IEEE Transactions on Medical Imaging, 19, 8, 809-814, (2000)
[13] Gong, M.; Zhao, S.; Jiao, L.; Tian, D.; Wang, S., A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information, IEEE Transactions on Geoscience and Remote Sensing, 52, 7, 4328-4338, (2014)
[14] Woo, J.; Stone, M.; Prince, J. L., Multimodal registration via mutual information incorporating geometric and spatial context, IEEE Transactions on Image Processing, 24, 2, 757-759, (2015)
[15] Atli, I.; Saracoglu, A.; Gedik, O. S., The effect of contrast enhancement techniques on mutual information based image registration, Proceedings of the 25th Signal Processing and Communications Applications Conference, SIU 2017
[16] Legg, P. A.; Rosin, P. L.; Marshall, D.; Morgan, J. E., Feature Neighbourhood Mutual Information for multi-modal image registration: An application to eye fundus imaging, Pattern Recognition, 48, 6, 1937-1946, (2015)
[17] Pradhan, S.; Singh, A.; Patra, D., Enhanced mutual information-based multimodal brain MR image registration using phase congruency, Progress in Intelligent Computing Techniques: Theory, Practice, and Applications, 518, 197-205, (2018)
[18] Rueckert, D.; Clarkson, M. J.; Hill, D. L.; Hawkes, D. J.; Hanson, K. M., Non-rigid registration using higher-order mutual information, Proceedings of the International Society for optics and Photonics, Medical Imaging 2000
[19] Penney, G. P.; Blackall, J. M.; Hamady, M. S.; Sabharwal, T.; Adam, A.; Hawkes, D. J., Registration of freehand 3D ultrasound and magnetic resonance liver images, Medical Image Analysis, 8, 1, 81-91, (2004)
[20] Cho, D. S.; Linte, C.; Chen, E. C. S.; Bainbridge, D.; Wedlake, C.; Moore, J.; Barron, J.; Patel, R.; Peters, T., Predicting target vessel location on robot-assisted coronary artery bypass graft using CT to ultrasound registration, Medical Physics, 39, 3, 1579-1587, (2012)
[21] Linte, C. A.; Moore, J.; Wedlake, C.; Bainbridge, D.; Guiraudon, G. M.; Jones, D. L.; Peters, T. M., Inside the beating heart: An in vivo feasibility study on fusing pre- and intra-operative imaging for minimally invasive therapy, International Journal for Computer Assisted Radiology and Surgery, 4, 2, 113-123, (2009)
[22] Lang, P.; Chu, M. W. A.; Bainbridge, D.; Guiraudon, G. M.; Jones, D. L.; Peters, T. M., Surface-based CT-TEE registration of the aortic root, IEEE Transactions on Biomedical Engineering, 60, 12, 3382-3390, (2013)
[23] Li, F.; Holmes III, D. R.; Wong, K. H.; Lang, P.; Rajchl, M.; Chen, E. C.; Guiraudon, G.; Peters, T. M., Towards real-time 3D US-CT registration on the beating heart for guidance of minimally invasive cardiac interventions, Proceedings of the Medical Imaging 2012: Image-Guided Procedures, Robotic Interventions, and Modeling. International Society for Optics and Photonics
[24] Rother, C.; Kolmogorov, V.; Blake, A., “Grab Cut” - interactive foreground extraction using iterated graph cuts, Acm Transactions on Graphics, 23, 3, 309-314, (2004)
[25] Dice, L. R., Measures of the amount of ecologic association between species, Ecology, 26, 3, 297-302, (1945)
[26] Fitzpatrick, J. M.; West, J. B.; Maurer, C. R., Predicting error in rigid-body point-based registration, IEEE Transactions on Medical Imaging, 17, 5, 694-702, (1998)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.