Face Image Animation - Using Warp?

Question

I plan to make a similar application similar to the one below on Android and Iphone.

http://www.motionportrait.com/en/technology/

http://www.youtube.com/watch?v=P-mBdV3icMY

What have i tried?

1) I tried the image warping method to make the expressions that I achieved with good accuracy. And this is the result of the image .

2) I also tried displaying opengl + Texture, where I could not get better accuracy.

Where am I stuck?

I did not succeed in a few things, such as turning the face.

Can someone teach me the methods used for this application, and how to move on further?

Login:. The input to my application is a 2D front-facing image.

Expected Result: A turning face and facial expressions.

Answer 1

As I know, for rotation you need to have a parametric (3D) model of the head (20-100 parameters). Getting this model is the hardest part of the project. Usually you get about 1,000 3D heads, then apply a PCA to them to get the parameters. After the user takes a picture, you can evaluate the parameters of this model (collapse it). Now you have a three-dimensional head model of the user and a front view of a textured model. All you have to do is project a photo onto this model to get a texture. For example, unknown areas filled with texture patterns of open skin.

Answer 2

You probably need to get a series of images with different reactions to the face. Then animate the images with a shorter animation duration so that they feel like they are real. You could probably read about the sensors and touches on the iPhone for the mouseHover effect.