Surface automation

Surface automation is automation based on recognition of images and texts visible on a computer's screen.

• Overview of surface automation

  Use surface automation to work around limitations to map application controls or extract texts from the computer's screen when you can't do it by getting their attributes or properties.

• Recommended settings to work with surface automation

  The screen resolution, scale, and color depth interfere in the quality or success of the automation that is made through image or text recognition, so make sure you prepare your computer with the recommended settings.

• Capture snips from screen captures

  Snips from screen captures are images that define the position on the computer's screen where the bot needs to act on. It is a key step in surface automation because the IBM RPA's vision driver uses it to find elements on the screen, like application controls.

• Actions for surface automation

  Add specific actions to your script like checking whether an image is on the screen, waiting an image to appear, finding and click at the center of an image, or parsing an image to get strings from it by using OCR.