So, at this point, I'm not sure if this is a programming or a physics problem! I'm attempting to concatinate 2 video inputs together to cover a wider field of view. As far as I can tell, this is usually done by "stitching" using matching keypoints in the two images. This can be computationally expensive, and as I'm trying to show the output in real time, my approach has been a simple mechanical allignment and a pixel overlap, blending/merging the overlap together.
Here's the problem. Usually stitching is done with 2 cameras placed next to each other. My cameras are places 3 meters apart. Two different point of views resulting in two different perspectives.
Now, the stitching doesn't have to be absolutely perfect. My goal is to concatinate the inputs while NOT losing objects. Obviously, depending on the field of view of the cameras, there will be a "dead space" close to the cameras.
Here's my starting point:
One idea was to do a cut with an angle and then stitch the images together. That way, I keep information close by while avoiding double objects further out. But this introduces an unwanted distortion and I still get double objects further out:
Any ideas how to move forward? Any help appriciated!