I asked a lot of questions related to stitching images, because I DO NOT understand, I DO NOT understand some things :(
I am currently working on stitching images based on multidimensional images based on homography and have some problems that I cannot solve on my own. I am using Visual Studio 2008/2010 and OpenCV 2.3.1 to work on my project.
I will describe them below:
First of all, I put some things (code, video ... etc.) that will be mentioned later in the next link, as I will limit only 2 links to messages at present ...
https://docs.google.com/folder/d/0B2r9FmkcbNwAM2drVHVJUktnS3M/edit
Plz take a look at the video "Stitching_HomographyBased.avi" that exists in the link mentioned above.
A 12 second video shows how my code works. I use 2 webcams, put them as close as possible and in different orientations with a rough 30% ~ 50% overlapping region. Pictures 1 and 2 show pictures taken by two cameras separately. The wider window, of course, shows a aligned (stitched) panorama.
However, the video shows a problem that the distorted image is not correctly aligned (see 0:04, where my laboratory assistant stands at the border of two images)
After some research into related studies, I suggested that one of the main reasons leading to this result may be due to the fact that I did not calibrate the camera on both cameras, and radial and tangential distortions cause an error. I think this is correct or there may be some other factors that also lead to this mismatch?
Then I tried to calibrate the camera using the existing code to calibrate the camera and checkerboard, but I just kept getting weird results. Plz see another video called "BadCalibration.avi" in the link. What happened to how I calibrate the camera?
My code is also downloaded from the link above and it is called Stitching1024.cpp
Thanks for the help.