Matching a RGB image with Depth image

Hey so I have this three images and I need to extract from the depth image, all the depth data coincident/associated with the cropped RGB image. How can i solve this? I need to get the depth data from the depth image so I can eventually get a point cloud with just the part from the cropped RGB image.

Answer 1

[Image Analyst]

Maybe you can use drawrectangle() to have the user outline some part of one of the images and then just analyze in that area of the depth image. Is the rgb image reasonably well aligned with the depth image?

[Bruno Neto]

I did no calibration of the alignment of those images but I think they are well aligned. At least it worked for me once before with a sort of example

[Image Analyst]

See attached demo.