Microsoft Gives Copilot Access to Local Files and Windows Actions

At its Windows and Surface event, Microsoft showed off an upgrade to its Copilot AI system that will give it access to local files on users' PCs and the ability to take actions across the operating system. The capabilities are part of an idea Microsoft is calling "Hybrid Intelligence," where apps and tools rely on a mix of local and cloud AI models to accomplish tasks efficiently.

Hybrid Intelligence in Action

To demonstrate how Hybrid Intelligence works, Jacob Andreou, Microsoft's EVP of Copilot, walked through a video demo onstage asking Microsoft's Autopilot tool to help with filing taxes. Andreou told the AI agent that he received an email from his accountant and asked Autopilot to get her what she needs.

Autopilot then used Hybrid Intelligence to search across different folders to find the documents, rename the files, zip them into a folder, and draft an email to send to the accountant with the zip file attached. According to Andreou, features powered by Hybrid Intelligence will be coming to Copilot over the "next couple months."

New Windows Search Experience

Microsoft also showed off a new Windows search experience that lets users take quick actions from the search bar, such as turning on dark mode, turning up microphone volume with an in-line slider, or even sending a text. The new experience will be available starting this fall on Windows 11 PCs, according to Pavan Davuluri, Microsoft's Windows and Surface boss.

Sources: Theverge