Microsoft has unveiled a game changing capability for Copilot Studio this week that significantly expands how businesses can leverage AI for automation. The new “computer use” feature enables AI agents to directly interact with websites and desktop applications, mimicking human actions to complete complex tasks without requiring API access.
AI That Operates Like a Human User
“Computer use enables agents to interact with websites and desktop apps by clicking buttons, selecting menus, and typing into fields on the screen,” explains Charles Lamanna, corporate vice president of Microsoft’s business & industry Copilot. “This allows agents to handle tasks even when there is no API available to connect to the system directly. If a person can use the app, the agent can too.”
This development positions Microsoft competitively alongside similar innovations from OpenAI’s Operator and Claude’s “computer use” feature, creating more options for businesses seeking advanced automation solutions.
Resilient Automation for Everyday Business Tasks
The capabilities extend far beyond simple interactions. According to Microsoft, Copilot Studio can now create AI agents that automate data entry processes, conduct comprehensive market research, and streamline invoice processing. Perhaps most impressively, these agents can adapt when interfaces change, detecting modifications to buttons and screens while continuing to function without disruption.
This adaptability addresses a common pain point in automation—the fragility of systems when faced with interface updates or changes.
Building on Consumer Features
This enterprise-focused enhancement follows Microsoft’s recent addition of “Actions” to its consumer Copilot offering earlier this month. The consumer version allows Copilot to perform background tasks like booking restaurant reservations, purchasing event tickets, and completing online shopping transactions while users focus on other activities.
While the consumer Actions feature currently operates with a limited number of partners, the business oriented computer use capability in Copilot Studio appears to offer broader application across websites and desktop software.
Implications for Business Productivity
This advancement represents a significant step toward more accessible automation for businesses of all sizes. By removing the technical barrier of API integration, Microsoft has opened the door for companies to automate processes across legacy systems and third-party applications that previously required manual handling.
As AI continues to evolve from conversational assistant to active digital worker, Microsoft’s computer use feature may prove to be a pivotal development in the ongoing transformation of workplace productivity.
