Speckle-pattern based sensors operate with a spatial neighborhood codification strategies to exploit a unique pattern. The label associated to a pixel is derived from the spatial pattern distribution within its local neighborhood. Thus, labels of neighboring pixels share information and provide an interdependent coding. Representing one of the most popular devices based on structured light projection, the Microsoft Kinect exploits an RGB camera, an IR (infrared) camera, and an IR projector. The IR projector projects a known structured light pattern in the form of a random but unique speckle dot pattern onto the scene. As IR camera and IR projector form a stereo pair, the pattern matching in the IR image results in a raw disparity image which, in turn, is read out as depth image.
Explain the principles of operation of the speckle-pattern based sensor
In progress