List of robotic vision sensors and image libraries

A 2D vision sensor or an ordinary camera delivers 2D image frames of the surroundings, whereas a 3D vision sensor delivers 2D image frames and an additional parameter called the depth of each image point. We can find the x, y, and z distance of each point from the 3D sensor with respect to the sensor's axis.

There are quite a few vision sensors available on the market. Some of the 2D and 3D vision sensors that can be used in our robot are mentioned in this chapter.

Pixy2/CMUcam5

The following picture shows the latest 2D vision sensor, called Pixy2/CMUcam5 (https://pixycam.com/pixy-cmucam5/), which is able to detect color objects with high speed and accuracy, and can be interfaced with an Arduino board. Pixy can be used for fast object detection, and the user can teach it which object it needs to track. The Pixy module has a CMOS sensor and NXP LPC4330 (http://www.nxp.com/) based on Arm Cortex M4/M0 cores for picture processing. The following...