This may be due to the accuracy of the calibration - both internal (for example, the same camera model, and how it copes with distortions), and external (i.e. the camera poses in real space). Together, of course, this dictates the maximum accuracy of your projection.
Do you have an indicator of camera calibration error - in terms of MSE redesign?
The cumulative error often manifests itself in my experience, if you simply repeat the subsequent images. Some form of global optimization often needs to be performed for the first correct positions for all camera poses.
. , , / ( /), , ( - / / ..).
, "" ? ( ICP ...). "" ? , ?
, (- ) , "" . ( → → → ...)
MeshLab BTW?