Game-theoretical occlusion handling for multi-target visual tracking.

*(English)*Zbl 1323.68532Summary: Multi-target visual tracking is a challenge because of data association and mutual occlusion in the interacting targets. This paper presents a Gaussian mixture probability hypothesis density based multi-target visual tracking system with game-theoretical occlusion handling. Firstly, the spatial constraint based appearance model with other interacting targets’ interferences is modeled. Then, a two-step occlusion reasoning algorithm is proposed. Finally, an \(n\)-person, non-zero-sum, non-cooperative game is constructed to handle the mutual occlusion problem. The individual targets within the occlusion region are regarded as the players in the constructed game to compete for the maximum utilities by using the certain strategies. A Nash Equilibrium of the game is the optimal estimation of the locations of the players within the occlusion region. Experiments on video sequences demonstrate the good performance of the proposed occlusion handling algorithm.

##### Keywords:

multi-target visual tracking; GM-PHD filter; occlusion handling; game theory; appearance model
PDF
BibTeX
XML
Cite

\textit{X. Zhou} et al., Pattern Recognition 46, No. 10, 2670--2684 (2013; Zbl 1323.68532)

Full Text:
DOI

##### References:

[1] | Kim, M., Correlation-based incremental visual tracking, Pattern Recognition, 45, 3, 1050-1060, (2012) · Zbl 1227.68110 |

[2] | Ross, D. A.; Lim, J.; Lin, R. S.; Yang, M.-H., Incremental learning for robust visual tracking, International Journal of Computer Vision, 77, 125-141, (2008) |

[3] | B. Babenko, M.-H. Yang, S. Belongie, Visual tracking with online multiple instance learning, in: IEEE Conference on Computer Vision and Pattern Recognition. June 2009, pp. 983-990. |

[4] | Comaniciu, D.; Ramesh, V.; Meer, P., Kernel-based object tracking, IEEE Transactions on Pattern Analysis and Machine Intelligence, 25, 5, 564-577, (2003) |

[5] | Bai, T.; Li, Y. F., Robust visual tracking with structured sparse representation appearance model, Pattern Recognition, 45, 6, 2390-2404, (2012) · Zbl 1234.68392 |

[6] | Goodman, I. R.; Mahler, R.; Nguyen, H. T., Mathematics of data fusion, (1997), Kluwer Academic Press Norwell, MA · Zbl 0882.68140 |

[7] | Mahler, R., Multitarget Bayes filtering via first-order multitarget moments, IEEE Transactions on Aerospace and Electronic Systems, 39, 4, 1152-1178, (2003) |

[8] | Vo, B.-N.; Ma, W. K., The Gaussian mixture probability hypothesis density filter, IEEE Transactions on Signal Processing, 54, 11, 4091-4104, (2006) · Zbl 1374.94614 |

[9] | B. Ristic, D. Clark, B.-N. Vo, Improved SMC implementation of the PHD filter, in: 13th International Conference on Information Fusion. July 2010, pp. 1-8. |

[10] | Maggio, I. E.; Taj, M.; Cavallaro, A., Efficient multi-target visual tracking using random finite sets, IEEE Transactions on Circuits and Systems for Video Technology, 18, 8, 1016-1027, (2008) |

[11] | Wang, Y. D.; Wu, J. K.; Kassim, A. A.; Huang, W. M., Data-driven probability hypothesis density filter for visual tracking, IEEE Transactions on Circuits and Systems for Video Technology, 18, 8, 1085-1095, (2008) |

[12] | Vo, B.-N.; Vo, B.-T.; Pham, N.-T.; Suter, D., Joint detection and estimation of multiple objects from image observations, IEEE Transactions on Signal Processing, 58, 10, 5129-5141, (2010) · Zbl 1392.94046 |

[13] | Maggio, E.; Cavallaro, A., Learning scene context for multiple object tracking, IEEE Transactions on Image Processing, 18, 8, 1873-1884, (2009) · Zbl 1371.93146 |

[14] | N.T. Pham, W.M. Huang, S.H. Ong, Tracking multiple objects using probability hypothesis density filter and color measurements, in: IEEE International Conference on Multimedia and Expo. July 2007, pp. 1511-1514. |

[15] | Wu, J. J.; Hu, S. Q.; Wang, Y., Probability-hypothesis-density filter for multitarget visual tracking with trajectory recognition, Optical Engineering, 49, 12, (2010), 12970-11-12970-19 |

[16] | Dockstader, S. L.; Tekalp, A. M., Multiple camera tracking of interacting and occluded human motion, Proceedings of IEEE, 89, 10, 1441-1455, (2001) |

[17] | Z. Wu, N.I. Hristov, T.L. Hedrick, T.H. Kunz, M. Betke, Tracking a large number of objects from multiple views, in: IEEE 12th International Conference on Computer Vision. October 2009, pp. 1546-4553. |

[18] | Khan, S. M.; Shah, M., Tracking multiple occluding people by localizing on multiple scene planes, IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 3, 505-519, (2009) |

[19] | Cai, L.; He, L.; Xu, Y.; Zhao, Y.; Yang, X., Multi-object detection and tracking by stereo vision, Pattern Recognition, 43, 12, 4028-4041, (2010) |

[20] | Zhao, T.; Nevatia, R.; Wu, B., Segmentation and tracking of multiple humans in crowded environments, IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 7, 1198-1211, (2008) |

[21] | Khan, Z.; Balch, T.; Dellaert, F., MCMC data association and sparse factorization updating for real time multitarget tracking with merged and multiple measurements, IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 12, 1960-1972, (2006) |

[22] | Y. Wu, T. Yu, G. Hua, Tracking appearances with occlusions, in: IEEE Conference on Computer Vision and Pattern Recognition. June 2003, pp. I-789-I-795. |

[23] | Hu, W. M.; Li, X.; Luo, W. H.; Zhang, X. Q., Single and multiple object tracking using log-euclidean Riemannian subspace and block-division appearance model, IEEE Transactions on Pattern Analysis and Machine Intelligence, 34, 12, 2420-2440, (2012) |

[24] | Li, G. R.; Qu, W.; Huang, Q. M., A multiple targets appearance tracker based on object interaction models, IEEE Transactions on Circuits and Systems for Video Technology, 22, 3, 450-464, (2012) |

[25] | M. Yang, T. Yu, Y. Wu, Game-theoretic multiple target tracking, in: IEEE 11th International Conference on Computer Vision. October 2007, pp. 1-8. |

[26] | Vezzani, R.; Grana, C.; Cucchiara, R., Probabilistic people tracking with appearance models and occlusion classification: the ad-hoc system, Pattern Recognition Letters, 32, 867-877, (2011) |

[27] | Xing, J. L.; Ai, H. Z.; Liu, L. W.; Lao, S. H., Multiple player tracking in sports video: A dual-mode two-way Bayesian inference approach with progressive observation modeling, IEEE Transactions on Image Processing, 20, 6, 1652-1667, (2011) · Zbl 1372.94278 |

[28] | Papadourakis, V.; Argyros, A., Multiple objects tracking in the presence of long-term occlusions, Computer Vision and Image Understanding, 114, 835-846, (2010) |

[29] | Hu, W. M.; Zhou, X.; Hu, M.; Manbank, S., Occlusion reasoning for tracking multiple people, IEEE Transactions on Circuits and Systems for Video Technology, 19, 1, 114-121, (2009) |

[30] | Senior, A.; Hampapur, A.; Tian, Y. L.; Brown, L.; Pankanti, S.; Bolle, R., Appearance models for occlusion handling, Image Vision Computing, 24, 11, 1233-1243, (2006) |

[31] | C.H. Kuo, C. Huang, R. Nevatia, Multi-target tracking by on-line learned discriminative appearance models, in: IEEE Conference on Computer Vision and Pattern Recognition, June 2010, pp. 685-692. |

[32] | Seong, Y. M.; Park, H. W., Multiple target tracking using cognitive data association of spatiotemporal prediction and visual similarity, Pattern Recognition, 45, 9, 3451-3462, (2012) |

[33] | Wang, H. Z.; Suter, D.; Schindler, K.; Shen, C., Adaptive object tracking based on an effective appearance filter, IEEE Transactions on Pattern Analysis and Machine Intelligence, 29, 9, 1661-1667, (2007) |

[34] | Nash, J., Two-person cooperative games, Econometrica, 21, 1, 128-140, (1953) · Zbl 0050.14102 |

[35] | Barron, E. N., Game theory: an introduction, (2008), Wiley · Zbl 1142.91001 |

[36] | Gu, D. B., A game theory approach to target tracking in sensor networks, IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, 41, 1, 2-13, (2011) |

[37] | C. Soto, B. Song, A.K. Roy-Chowdhury, Distributed multi-target tracking in a self-configuring camera network, in: IEEE Conference on Computer Vision and Pattern Recognition. June 2009, pp. 1486-1493. |

[38] | X.Q. Zhang, W.M. Hu, G. Luo, S. Manbank, Kernel-yesian framework for object tracking, in: 8th Asian Conference on Computer Vision. November 2007, pp. 821-831. |

[39] | Available from: 〈http://imagelab.ing.unimore.it/visor/video_categories.asp〉 |

[40] | Available from: 〈http://homepages.inf.ed.ac.uk/rbf/CAVIARDATA1/〉 |

[41] | Available from: 〈http://www.cvg.rdg.ac.uk/PETS2006/data.html〉 |

[42] | Bernardin, K.; Stiefelhagen, R., Evaluating multiple object tracking performance: the CLEAE MOT metrics, EURASIP Journal of Image and Video Processing, 2008, 1-10, (2008) |

[43] | Vo, B.-N.; Singh, S.; Doucet, A., Sequential Monte Carlo methods for multitarget filtering with random finite sets, IEEE Transactions on Aerospace and Electronic Systems, 41, 4, 1224-1245, (2005) |

This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.