I’m trying to reprojection one camera’s image to the other’s.
My target is to completely compare two images from different camera.
So far, I have tried some methods, like Rotation and Translation, Homography and Imaging Principle,but all of the results are not good.
-
Rotation and Translation
I use Stereo Camera Calibrator from MATLAB to get the internal reference and external reference.
And use Rotate Translate matrix into an image, try to reprojection image1 to image2.
but the result is not good enough.
If I subtract two images, I will get a whole black image, But actually it looks like this. -
So I try Homography matrix. its result is good, but this method only applies to the same image plane.
like this one, left half is great, but right is bad, its because left half and right half are not in the same image pane, so they have obvious error. -
Now I try the last method I know.”Imaging Principle”
I use ZED (stereo camera) to get depth from left image, and internal reference and external reference from Zed left and right camera. Then I use Imaging Principle to reprojection left image to right image. and the result like this. It seems works! but still needs improvement.
So far, it works on ZED’s two camera, but I hope it can work on two different camera, One is ZED the other is a normal webcam.
What improvements can I do, and how can it be better implemented on different cameras?