How can I set the landmarks for different facial components like (eyebrow, eye, nose & lips) on a front posed face image (neutral emotion) and how to track the points of those fixed landmarks on the front posed face image of (different emotions) ?

How to set the landmarks (Red coloured points) as given in the image for different facial components like (eyebrow, eye, nose & lips) on a front posed face image (neutral emotion) and how to track the points of those fixed landmarks on the front posed face image of (different emotions) ?

[Walter Roberson]

Do not tag individuals.

[Walter Roberson]

The poster commented, "sorry sir i am new to this, actually i cant able to post this question without tagging anybody thats the reason i tagged you am really sorry for your inconvenience. "

[Walter Roberson]

http://www.mathworks.co.uk/matlabcentral/answers/43073-a-guide-to-tags

[Ambeshwar kumar]

https://in.mathworks.com/matlabcentral/fileexchange/47713-facial-landmarks

try this.

Answer 1

[Image Analyst]

We can't really help with long complicated algorithm development questions like that. What you've asked for is no 5-minute answer -- people have been working on that for years. You can find their algorithms by looking up the papers they've published on them, which are cited here:

http://www.visionbib.com/bibliography/contentspeople.html#Face%20Recognition,%20Detection,%20Tracking,%20Gesture%20Recognition,%20Fingerprints,%20Biometrics

21.3.6 Facial Expressions and Emotion Analysis and Description
    21.3.6.1 Face Expression Recognition and Analysis, Facial Expression Analysis, Facial Expressions
        21.3.6.1.1 Face Expression Recognition for Human Comupter Interaction
        21.3.6.1.2 Applied Face Expression Recognition, Specific Expressions
        21.3.6.1.3 Three-Dimensional Face Expression Recognition and Analysis
        21.3.6.1.4 Face Action Units for Expressions and Motion Analysis, FAU, FACS
        21.3.6.1.5 Facial Feature Tracking for Expressions
        21.3.6.1.6 Face Expression Recognition from a Single Image 
    21.3.6.2 Emotion Recognition from Face Images
        21.3.6.2.1 Emotion Recognition, from Other Than Faces

Pick a paper then code it up.

[SWAMINATHAN]

thank you for your valuable reply sir. i need your guidance and support forever. thank you once again

Answer 2

[Dima Lisin]

Hi Swaminathan,

You can use vision.CascadeObjectDetector in the Computer Vision System Toolbox to detect faces, eyes, noses, and mouths. You can also use functions such as detectHarrisFeatures or detectFastFeatures to detect corners inside those regions. Finally, you can use vision.PointTracker to track corners across video frames.

[SWAMINATHAN]

Thank you very much for your valuable reply. it helps me very much. One small doubt while executing your detectAndTrackFaces.m code am having this problem Undefined function or variable 'webcam'. Error in detectAndTrackFaces (line 10) vidObj = webcam; please help me tp rectify this am using matlab 2013b

[Dima Lisin]

Webcam support is only available in base MATLAB R2014b or later. You can use Image Acquision Toolbox to capture video instead, or read video from a file.

[SWAMINATHAN]

Thank you very much for for kind response for my question sir.I need your support forever :-)