In the 2012 FIRST® robotics game, Rebound Rumble™ robots could aim their basketball shooters with the help of a webcam and retro-reflective vision target. Retro-reflective materials reflect light directly back at the light source. Safety reflectors and road signs are an example of retro-reflective material where the light from car headlights is reflected directly back at the driver instead of reflecting the light off at another angle like mirrors do. Using this property of reflection a ring of LEDs were mounted around the webcam lens to illuminate the vision targets.

LEDs Mounted on webcam
There are two ways for the robot to search the picture from the webcam to try and find the rectangular vision targets, one is to look for bright rectangles, the other is to look for rectangles that are a specific color. Looking for a rectangle based on brightness is straight forward, however, the computer can be confused by other bright objects in the picture such as the sunlight coming in through windows. Looking for a specific color eliminates the confusion caused by the sunlight because the computer looks for a bright green target instead of just a bright target.

Bright green vision targets
The bright green rectangles pop off the image and standout from the surrounding background.
This is what the robot sees
Each rectangle the robot sees is displayed as a red rectangle on a black background to indicate to the operators what exactly the robot is seeing. Green numbers displayed next to each rectangle indicate the position of each rectangle. Using the location of the rectangles and some trigonometry allows the robot to calculate how far away the target is and if the robot is lined up with the target. Taking the calculated distance from the target the robot and the left and right measurements the robot can automatically aim and adjust the power used to shoot the basketball. Using the computer on the robot to assist the drivers in aiming and shooting the basketballs reduced the workload for the drivers and improved accuracy.
Automotive robots and package sorting systems are examples of robots that use the same basic vision system teams used in Rebound Rumble. Automotive robots use vision systems to see where parts need to be placed and welded; package sorting systems use cameras to read barcodes and other identifying features to send packages to their proper destinations.
Watch the Rebound Rumble game animation on YouTube.
Learn more about FIRST Robotics at www.usfirst.org/frc.
