Saying laptop use in Copilot Studio! This new function permits your Copilot Studio brokers to work together instantly with web sites and desktop purposes. Need to be a part of the restricted preview? Learn on.
AI innovation is accelerating at an unprecedented tempo, and Microsoft Copilot Studio is on the forefront—integrating one of the best AI developments right into a platform constructed to resolve enterprise challenges at scale. Final month, we launched deep reasoning capabilities for brokers, assist for mannequin context protocol (MCP), and the overall availability of agent flows in Copilot Studio.
In the present day, we’re excited to announce that laptop use is coming to Copilot Studio by means of an early entry analysis preview. This new functionality permits your Copilot Studio brokers to deal with web sites and desktop purposes as instruments. With laptop use, brokers can now work together with any system that has a graphical consumer interface!
Obtain new efficiencies with laptop use
Laptop use permits brokers to work together with web sites and desktop apps by clicking buttons, deciding on menus, and typing into fields on the display. This permits brokers to deal with duties even when there isn’t a API obtainable to hook up with the system instantly. If an individual can use the app, the agent can too.
Laptop use adapts to modifications in apps and web sites mechanically. It adjusts in actual time utilizing built-in reasoning to repair points by itself, so work continues with out interruption. It is usually constructed on Copilot Studio’s sturdy safety measures and governance frameworks, to assist guarantee compliance with organizational and trade requirements.
With laptop use in Copilot Studio, makers can construct brokers that automate duties on consumer interfaces throughout each desktop and browser purposes, together with Edge, Chrome, and Firefox. Moreover, laptop use runs on Microsoft-hosted infrastructure, that means organizations don’t must handle their very own servers. Enterprise knowledge stays inside Microsoft Cloud boundaries and isn’t used to coach the Frontier mannequin. This helps your group speed up deployment, scale back upkeep, and decrease infrastructure prices.
Unlock new worth with agentic and automation eventualities
To carry this know-how to life, think about the next excessive worth use instances:
Automated knowledge entry: Think about a state of affairs the place an enterprise must enter giant volumes of information from numerous sources right into a centralized system. Laptop use can automate this course of, decreasing handbook effort and minimizing errors.
Market analysis: Advertising groups can leverage the software to automate the gathering of market knowledge from numerous on-line sources for evaluation, offering helpful insights with out the necessity for handbook intervention.
Bill processing: For finance departments, the software can automate the extraction of information from invoices and enter it into accounting methods, streamlining all the invoicing course of and decreasing handbook errors.
Reimagining robotic course of automation (RPA)
Laptop use brokers are reworking robotic course of automation (RPA). They overcome conventional limitations, just like the fragility of UI components, and might deal with complicated dynamic interfaces. This makes automation accessible to individuals past skilled RPA builders.
In Copilot Studio, laptop use addresses widespread RPA challenges by making automation smarter and extra intuitive:
It responds to modifications in actual time: When buttons or screens change, the software retains working with out breaking your movement.
It’s simple to make use of: You may describe what you need in pure language, no coding wanted, and check and refine the immediate with real-time side-by-side video of the pc use reasoning chain and the deliberate UI automation.
It’s constructed with intelligence: The agent sees what’s on the display and makes sensible choices in actual time, even in complicated or always altering environments.
It comes with full visibility: Makers can view a historical past of laptop use exercise at will, together with captured screenshots and reasoning steps.
The way forward for innovation with Copilot Studio
Copilot Studio is the end-to-end agent platform designed to assist organizations obtain their AI and operational targets. We need to empower you to streamline processes, improve productiveness, and drive innovation.
If you’re excited about exploring the brand new laptop use functionality, we might love to listen to from you! Please fill out this type to tell us you want to take part.
We can even share extra about this new announcement at Microsoft Construct in Could 2025—register right here to affix us!
