Moving Camera Motion Detection

Question

How to track the movement of objects when the camera moves. An example is if the camera is inside a vehicle. So far I have been tying algorithms in Optical Flow in Emgu Cv. I want to get the horizontal movement of an object. But they do not give sufficient results to detect horizontal movement when the camera moves forward.

pyrLK is a good tracker, but when I take the difference between the new calculated point and the previous points, it makes no sense, maybe new points will be added for each frame. Is this possible with a single camera or do I need to use stereo sound. Please ask someone to help with this. I'll be very grateful.

thank

(hope the question is not too broad)

Answer 1

I would suggest using color tracking. If the objects you are trying to track have a clear color, you should be able to adjust them appropriately.

One way to achieve this is to choose the appropriate space for the color as the RGB space. Keep in mind that this may be too sensitive, even with a small dispersion of lighting. (It really depends on the objects you want to track and track the script.)