Microsoft introduces new Copilot automation features for Windows 11

Microsoft Corp. today unveiled a series of upgrades to the version of its Copilot artificial intelligence assistant that ships with Windows 11.

Some of the improvements are generally available now, while others can be accessed through the company's Windows Insider beta testing program.

All Windows 11 users in markets where Copilot is offered can now access Copilot Vision, a version of the Assistant with computer version features. Consumers may ask for guidance on how to navigate the interface of a newly downloaded application. Copilot Vision can also generate text, provide graphic design advice, and perform other tasks.

Previously, consumers could only interact with Copilot Vision using voice commands. Microsoft plans to introduce a chatbot interface that provides support for text instructions. The standard version of Copilot, in turn, receives new voice controls. Users can now activate it by saying “Hey Copilot” and end a conversation by saying “Goodbye.”

A second set of AI improvements will be available through Microsoft's Windows Insider functional testing program. The innovations are led by a new version of Copilot Actions, an AI agent that the company first introduced in March. The tool can automatically perform multi-step tasks on behalf of the user.

The first version of the tool, launched in March, could only perform browser-based tasks. As part of the update announced today, Copilot Actions gains the ability to interact with the files on its host computer. The upgrade allows users to automate tasks such as extracting information from local PDF documents.

Copilot also gains the ability to access files stored in OneDrive and Google Drive. “Once you choose to connect to a service, Copilot can find and understand your personal content using your own words, making it easier to find and remember details in your connected personal content across multiple platforms,” Yusuf Mehdi, Microsoft’s consumer chief marketing officer, wrote in an article Blog post Today.

Another expansion of the Windows Insider program will make editing operating system settings easier. This allows users to describe the change they want to make in natural language and have Copilot bring up the appropriate settings page.

In addition to the new automation functions, there are a number of other improvements. Microsoft plans to add a button to the Windows 11 taskbar that will allow you to launch Copilot with one click. The company will also introduce Windows 11 integrations for Zoom, the Manus AI Agent Service and a video editing application called Filmora.

Image: Microsoft