AI Agents & Automation advanced

Computer Use

An agent operating a computer the way a person does — reading the screen, moving the cursor, typing.

Computer use lets an agent work with software that has no API by driving the interface directly. It unlocks legacy systems and long-tail tools at the cost of being slower and more brittle than a proper integration. Because it inherits the user’s full access, sandboxing is not optional.

In practice: Filling a form in an internal portal that was built in 2009 and has no API.

Where this comes up