1. Robot-vision interaction

1.1 Motivations

The visual sensor is an "exteroceptive" sensor. With its wealth of information, it is capable of understanding the robot's working environment.

The information extracted from the image can be used, for example, to correct the robot's trajectory to adapt to a variation in the dimensions of the parts to be processed. It is also possible to imagine a robotic system capable of automatically recognizing the type of part involved and adapting the task to the part and/or its position relative to the robot.

The visual sensor provides a stream of information. The real-time nature of this information can be used to correct the robot's position in real time, in particular to perform an on-the-fly task on a part circulating on a conveyor....