Align 2 face images with their marker points

Question

I use open cv and c ++. I have 2 face images that contain marker points on them. I already found the coordinates of the marker points. Now I need to align these 2 face images based on these coordinates. 2 images may not necessarily be the same height, so I cannot figure out how to start aligning them, what to do, etc.

Answer 1

In your case, you cannot apply the alignment procedure based on homography. Why not? Because it is not suitable in this use case. It was designed to level flat surfaces. Faces (3D objects) with markers in different places and depths obviously do not have a flat surface.

Instead, you can:

• try to match markers between images, then interpolate the offset field of the other pixels. Classic ways to do this would include least squares interpolation or RBF 's;
• "Face Processing" (, AAM) .

Answer 2

"align".

, , , , , , .

, , , . , ? ?

(, ), "" 3d-, ? .

? , , , , , .

...?