×

Camera calibration from very few images based on soft constraint optimization. (English) Zbl 1455.94043

Summary: Camera calibration is a basic and crucial problem in photogrammetry and computer vision. Although existing calibration techniques exhibit excellent precision and flexibility in classical cases, most of them need from 5 to 10 calibration images. Unfortunately, only a limited number of calibration images and control points can be available in many application fields such as criminal investigation, industrial robot and augmented reality. For these cases, this paper presented a two-step calibration based on soft constraint optimization, which is motivated by “no free lunch” theorem and error analysis. The key steps include (1) homography estimation with weighting function, (2) Initialization based on a simplified model, and (3) soft constraint optimization in terms of reprojection error. The proposed method provides direct access to geometric information of the object from very few images. After extensive experiments, the results demonstrate that the proposed algorithm outperforms Zhang’s algorithms from the point of view of the success ratio, accuracy and precision.

MSC:

94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
68U10 Computing methodologies for image processing
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Brown, M. Z.; Burschka, D.; Hager, G. D., Advances in computational stereo, IEEE Trans. Pattern. Anal. Mach. Intell., 25, 8, 993-1008 (2003)
[2] Weng, J.; Cohen, P.; Herniou, M., Camera calibration with distortion models and accuracy evaluation, IEEE Trans. Pattern. Anal. Mach. Intell., 14, 10, 965-980 (1992)
[3] Guillemaut, J.-. Y.; Aguado, A. S.; Illingworth, J., Using points at infinity for parameter decoupling in camera calibration, IEEE Trans. Pattern. Anal. Mach. Intell., 27, 2, 265-270 (2005)
[4] Tsai, R., A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf tv cameras and lenses, IEEE J. Robot. Autom., 3, 4, 323-344 (1987)
[5] Boby, R. A.; Saha, S. K., Single image based camera calibration and pose estimation of the end-effector of a robot, (Proceedings of the IEEE International Conference on Robotics and Automation. Proceedings of the IEEE International Conference on Robotics and Automation, Stockholm, SE (2016))
[6] Schillebeeckx, I.; Pless, R., Single image camera calibration with lenticular arrays for augmented reality, (Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, USA (2016))
[7] Wolpert, D. H.; Macready, W. G., No free lunch theorems for optimization, IEEE Trans. Evol. Comput., 1, 1, 67-82 (1997)
[8] Deutscher, J.; Isard, M.; Maccormick, J., Automatic camera calibration from a single manhattan image, (Proceedings of the European Conference on Computer Vision. Proceedings of the European Conference on Computer Vision, Copenhagen, DK (2002)) · Zbl 1039.68617
[9] de la Fraga, L. G.; Schuetze, O., Direct calibration by fitting of cuboids to a single image using differential evolution, Int. J. Comput. Vis., 81, 2, 119-127 (2009)
[10] Wilczkowiak, M.; Sturm, P.; Boyer, E., Using geometric constraints through parallelepipeds for calibration and 3D modeling, IEEE Trans. Pattern Anal. Mach. Intell., 27, 2, 194-207 (2005)
[11] Winkler, A. W.; Zagar, B. G., A curve fitting method for extrinsic camera calibration from a single image of a cylindrical object, Measur. Sci. Technol., 24, 8, 1-13 (2013)
[12] Chen, H. T., Geometry-based camera calibration using five-point correspondences from a single image, IEEE Trans. Circ. Syst. Video Technol., 27, 12, 2555-2566 (2017)
[13] Miyagawa, I.; Arai, H.; Koike, H., Simple camera calibration from a single image using five points on two orthogonal 1-D objects, IEEE Trans. Image Process., 19, 6, 1528-1538 (2010) · Zbl 1371.94266
[14] Avinash, N.; Murali, S., Perspective geometry based single image camera calibration, J. Math. Imaging Vis., 30, 3, 221-230 (2008) · Zbl 1523.68101
[15] Zhang, Z., A flexible new technique for camera calibration, IEEE Trans. Pattern Anal. Mach. Intell., 22, 11, 1330-1334 (2000)
[16] Liu, D.; Liu, X.; Wang, M., Camera self-calibration with lens distortion from a single image, Photogramm. Eng. Remote Sensing, 82, 5, 325-334 (2016)
[17] Zhou, F., Line-based camera calibration with lens distortion correction from a single image, Opt. Lasers Eng., 51, 12, 1332-1343 (2013)
[18] Zheng, Y.; Liu, Y., Camera calibration using one perspective view of two arbitrary coplanar circles, Opt. Eng., 47, 6, 1-9 (2008)
[19] Miraldo, P.; Araujo, H., Calibration of smooth camera models, IEEE Trans. Pattern Anal. Mach. Intell., 35, 9, 2091-2103 (2013)
[20] Heller, J.; Havlena, M.; Pajdla, T., Globally optimal hand-eye calibration using branch-and-bound, IEEE Trans. Pattern Anal. Mach. Intell., 38, 5, 1027-1033 (2016)
[21] Liu, A.; Marschner, S.; Snavely, N., Caliber: camera localization and calibration using rigidity constraints, Int. J. Comput .Vis., 118, 1, 1-21 (2016) · Zbl 1398.68588
[22] Häne, C., 3D visual perception for self-driving cars using a multi-camera system: calibration, mapping, localization, and obstacle detection, Image Vis. Comput., 68, 14-27 (2017)
[23] Hartley, R.; Zisserman, A., Multiple View Geometry in Computer Vision (2004), Cambridge University Press: Cambridge University Press New York · Zbl 1072.68104
[24] Szeliski, R., Computer vision: Algorithms and Applications (2010), Springer: Springer New York
[25] Pollefeys, M.; Koch, R.; Van Gool, L., Self-calibration and metric reconstruction inspite of varying and unknown intrinsic camera parameters, Int. J. Comput. Vis., 32, 1, 7-25 (1999)
[26] Boudine, B., A flexible technique based on fundamental matrix for camera self-calibration with variable intrinsic parameters from two views, J. Vis. Commun. Image Represent, 39, 40-50 (2016)
[27] Quan, L., Self-calibration of an affine camera from multiple views, Int. J. Comput. Vis., 19, 1, 93-105 (1996)
[28] Zhang, Z., Estimating motion and structure from correspondences of line segments between two perspective images, IEEE Trans. Pattern Anal. Mach. Intell., 17, 12, 1129-1139 (1995)
[29] Tamaskar, S.; Neema, K.; Delaurentis, D., Framework for measuring complexity of aerospace systems, Res. Eng. Des., 25, 2, 125-137 (2014)
[30] Wang, J., A new calibration model of camera lens distortion, Pattern Recognit., 41, 2, 607-615 (2008) · Zbl 1129.68554
[31] Liu, Z., High-accuracy calibration of low-cost camera using image disturbance factor, Opt. Express, 24, 21, 24321-24336 (2016)
[32] Krueger, L.; Woehler, C., Accurate chequerboard corner localisation for camera calibration, Pattern Recognit. Lett., 32, 10, 1428-1435 (2011)
[33] Zhang, Z., Flexible camera calibration by viewing a plane from unknown orientations, (Proceedings of the IEEE International Conference on Computer Vision. Proceedings of the IEEE International Conference on Computer Vision, Kerkyra, GR (1999), IEEE)
[34] Weng, J.; Huang, T. S.; Ahuja, N., Motion and structure from two perspective views: algorithms, error analysis, and error estimation, IEEE Trans. Pattern Anal. Mach. Intell., 11, 5, 451-476 (1989)
[35] Boyd, S.; Vandenberghe, L., Convex Optimization (2004), Cambridge University Press: Cambridge University Press New York · Zbl 1058.90049
[36] Salvi, J.; Armangué, X.; Batlle, J., A comparative review of camera calibrating methods with accuracy evaluation, Pattern Recognit., 35, 7, 1617-1635 (2002) · Zbl 1016.68095
[37] Hartley, R.; Kang, S. B., Parameter-free radial distortion correction with center of distortion estimation, IEEE Trans. Pattern Anal. Mach. Intell., 29, 8, 1309-1321 (2007)
[38] Wei, G. Q.; Ma, S. D., Implicit and explicit camera calibration: theory and experiments, IEEE Trans. Pattern Anal. Mach. Intell., 16, 5, 469-480 (1994)
[39] Marquardt, D. W., An algorithm for least-squares estimation of nonlinear parameters, J. Soc. Indust. Appl. Math., 11, 2, 431-441 (1963) · Zbl 0112.10505
[40] Douxchamps, D.; Chihara, K., High-accuracy and robust localization of large control markers for geometric camera calibration, IEEE Trans. Pattern Anal. Mach. Intell., 31, 2, 376-383 (2009)
[41] Heikkilä, J., Geometric camera calibration using circular control points, IEEE Trans. Pattern. Anal. Mach. Intell., 22, 10, 1066-1077 (2000)
[42] Bevington, P. R.; Robinson, D. K., Data Reduction and Error Analysis For the Physical Sciences (2003), McGraw-Hill: McGraw-Hill New York
[43] Montgomery, D. C., Design and Analysis of Experiments (2008), John Wiley & Sons: John Wiley & Sons Weinheim
[44] Kamgar-Parsi, B., Evaluation of quantization error in computer vision, IEEE Trans. Pattern Anal. Mach. Intell., 11, 9, 929-940 (1989)
[45] Geiger, A., Automatic camera and range sensor calibration using a single shot, (Proceedings of the IEEE International Conference on Robotics and Automation. Proceedings of the IEEE International Conference on Robotics and Automation, Paul, USA (2012))
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.