TY - GEN
T1 - Tracking facial feature points with prediction-assisted view-based active shape model
AU - Wang, Chao
AU - Song, Xubo
PY - 2011
Y1 - 2011
N2 - Facial feature tracking is a key step in facial dynamics modeling and affect analysis. Active Shape Model (ASM) has been a popular tool for detecting facial features. However, ASM has its limitations. Due to the finiteness of the training set, it cannot handle large variations in facial pose exhibited in video sequences. In addition, it requires accurate initiation. In order to address these limitations, we propose a novel approach that is capable of providing a more accurate shape initiation as well as automatically switching on multi-view models. We categorize the apparent 2D motions of facial feature points into global motion (the rigid part) and local motion (the non-rigid part) by whether they have relative movement in the image plane. We use the Kalman framework to predict the global motion, and then use adaptive block matching to refine the search for local motion. This will provide an initial shape closer to the real position for ASM. From this initial shape, we can estimate a rough head pose (yaw rotation), which in turn helps choose a suitable view-specific model automatically for ASM. We compare our method with the original ASM as well as with a newly developed competing method. The experimental results demonstrate that our approach have a higher flexibility and accuracy.
AB - Facial feature tracking is a key step in facial dynamics modeling and affect analysis. Active Shape Model (ASM) has been a popular tool for detecting facial features. However, ASM has its limitations. Due to the finiteness of the training set, it cannot handle large variations in facial pose exhibited in video sequences. In addition, it requires accurate initiation. In order to address these limitations, we propose a novel approach that is capable of providing a more accurate shape initiation as well as automatically switching on multi-view models. We categorize the apparent 2D motions of facial feature points into global motion (the rigid part) and local motion (the non-rigid part) by whether they have relative movement in the image plane. We use the Kalman framework to predict the global motion, and then use adaptive block matching to refine the search for local motion. This will provide an initial shape closer to the real position for ASM. From this initial shape, we can estimate a rough head pose (yaw rotation), which in turn helps choose a suitable view-specific model automatically for ASM. We compare our method with the original ASM as well as with a newly developed competing method. The experimental results demonstrate that our approach have a higher flexibility and accuracy.
KW - Kalman filter
KW - adaptive block matching
KW - facial feature points
KW - prediction-assisted active shape model
UR - http://www.scopus.com/inward/record.url?scp=79958738905&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=79958738905&partnerID=8YFLogxK
U2 - 10.1109/FG.2011.5771408
DO - 10.1109/FG.2011.5771408
M3 - Conference contribution
AN - SCOPUS:79958738905
SN - 9781424491407
T3 - 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011
SP - 259
EP - 264
BT - 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011
T2 - 2011 IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG 2011
Y2 - 21 March 2011 through 25 March 2011
ER -