A 3D-Eyeball/Skin Decorrelated Active Appearance Model

Hanan Salam; Renaud Seguier

IIAE CONFERENCE SYSTEM, The 1st IEEE/IIAE International Conference on Intelligent Systems and Image Processing 2013 (ICISIP2013)

Hanan Salam, Renaud Seguier

Last modified: 2013-10-01

Abstract

We propose 3D Multi-Texture Active Appearance Model (3D MT-AAM) where the skin and the eyeball are considered as two decorrelated objects contrary to classical AAM where the eye region is a continuous part of the face mesh. The iris is modeled as a sphere and rotates under the eye hole permitting the synthesis of new gaze directions. We compare the model with previous work that models the iris as a simple 2D texture and with a classical method and we obtain better results. In addition we propose a method for back-projecting the search result of our model from the model frame to the real image frame using barycentric coordinates. On the other hand, we explore different optimizations namely: Gradient descent (GD), Simplex, and Genetic Algorithm (GA) to optimize our model and we compare the performance of the system. We obtain the best performance using GA. However with Simplex we improve the computation time, with a slightly lower performance.

Keywords

gaze detection, active appearance models

References

(1) T. Cootes and G. Edwards, C. Taylor : “Active Apperance Models”, in IEEE European Conference on Computer Vision (ECCV), pp. 484, 1998

(2) H. Salam, R. Seguier and N. Stoiber : “A Multi-Texture Approach for estimating iris positions in the eye using 2.5D Active Appearance Models”, in Proceedings of the 19th IEEE International Conference on Image Processing, pp. 1833-1836, 2012

(3) I. Rechenberg : “Evolutionsstrategie – Optimierung technischer Systeme nach Prinzipien der biologischen Evolution”, PhD thesis, Berlin Technical University, 1971

(4) J. Nelder and R. Mead : “A simplex method for function minimization”, Computer Journal, Vol. 7, pp. 308–313, 1964.142

(5) U. Weidenbacher, G. Layher, P. M Strauss, and H. Neumann : “A comprehensive head pose and gaze database”, in 3rd IET International Conference on Intelligent Environments, pp. 455–458, 2007

(6) J. P Hansen, J. S Augustin, and H. Skovsgaard : “Gaze interaction from bed”, in Proceedings of the 1st Conference on Novel Gaze-Controlled Applications, pp. 11, 2011

(7) A. Perez, M. L Cordoba, A. Garcia, R. Mendez, M. L Munoz, J. L Pedraza, and F. Sanchez : “ A precise Eye-Gaze detection and tracking system”, in WSCG, 2003

(8) A. L Yuille, P. W Hallinan, and D. S Cohen : “Feature extraction from faces using deformable templates”, International journal of computer vision, Vol 8, No.2 pp. 99–111, 1992

(9) Qiu Chen, Koji Kotani, Feifei Lee, and Tadahiro Ohmi : “An accurate eye detection method using elliptical separability filter and combined features”, IJCSNS International Journal of Computer Science and Network Security, Vol. 9, No. 8, 2009.

(10) T. Ishikawa, S. Baker, I. Matthews, and T. Kanade : “Passive driver gaze tracking with activeappearance models”, 2004

(11) Kristen Grauman, Margrit Betke, James Gips, and Gary R Bradski : “Communication via eye blinks-detection and duration analysis in real time”, in Computer Vision and Pattern Recognition, pp. 1010-1017, 2001

(12) PM Hillman, JM Hannah, and PM Grant : “Global fitting of a facial model to facial features for model-based video coding”, in Image and Signal Processing and Analysis, Vol. 1, pp 359–364, 2003

(13) Jeffrey Huang and Harry Wechsler : “Eye detection using optimal wavelet packets and radial basis functions”, International Journal of Pattern Recognition and Artificial Intelligence, Vol. 3, No. 7, pp. 1009–1025, 1999

(14) D. W Hansen, M. Nielsen, J. P Hansen, A. S Johansen, and M. B Stegmann : “Tracking eyes using shape and appearance”. In IAPR Workshop on Machine Vision Applications-MVA, pp. 201–204, 2002.

(15) I. Bacivarov : “Advances in the Modeling of Facial Sub-Regions and Facial Expressions using Active Appearance Techniques. PhD thesis”, National University of Ireland, 2009

(16) P. Ivan. Active appearance models for gaze estimation. PhD thesis, Vrije University, Amsterdam, 2007

(17) A. Savran, N. Alyuz, B., H. Dibeklioglu, O. Celiktutan, B. Gokberk, B. Sankur and L. Akarun : “Bosphorus database for 3D face analysis”, in: Proceedings of the First COST Workshop on Biometrics and Identity Management (BIOD), pp. 47–56, 2008

(18) M. J Reale, S. Canavan, L. Yin, K. Hu, and T. Hung : “A Multi-Gesture interaction system using a 3-D iris disk model for gaze estimation and an active appearance model for 3-D hand pointing”, IEEE Transactions on Multimedia, Vol. 13, No. 3, pp. 474–486, 2011

(19) H. Yamazoe, A. Utsumi, T. Yonezawa, and S. Abe : “Remote and Head-Motion-Free gaze tracking for real environments with automated Head-Eye model calibrations”, in IEEE CVPR Workshop human communicative behavior analysis, pp. 1–6, 2008

(20) S. Asteriadis, D. Soufleros, K. Karpouzis, and S. Kollias : “A natural head pose and eye gaze dataset”, in Proceedings of the International Workshop on Affective-Aware Virtual Agents and Social Robots, pp. 1, 2009

(21) M. Dobes, L. Machala, P. Tichavskı, J. Pospisil : “Human eye iris recognition using the mutual information”. Optik-International Journal for Light and Electron Optics, pp. 399–404, 2004.

Full Text: PDF