Microsoft Launches Major AI Upgrades For Windows 11

Brings voice-powered Copilot to all PCs.

Microsoft is rolling out an extensive set of AI upgrades to Windows 11 in an ambitious move to embed AI deeply into the everyday computing experience.

The update, announced Thursday, supercharges Copilot, Microsoft's AI assistant, with new voice interaction features, enhanced on-screen understanding and expanded automation tools aimed at making PCs more intuitive, conversational and capable.

At the heart of the update is a new "Hey Copilot" activation feature, a wake word that allows users to summon Microsoft's AI assistant hands-free.

Once enabled, users can issue voice commands to perform tasks, ask questions, or navigate Windows without touching the mouse or keyboard.

The feature is part of a broader shift toward voice as a primary mode of interaction with computers, something Yusuf Mehdi, Microsoft's consumer chief marketing officer, says represents a major evolution in personal computing.

"It's been almost four decades since the PC changed the way you interact with it, which is primarily mouse and keyboard," Mehdi said.

"But what if you can go beyond that and talk to it? In our minds, voice would become the third input mechanism to use with your PC."

According to Mehdi, users interact with Copilot twice as often when using voice commands instead of typing, largely because of the convenience and immediacy of speaking.

Copilot Vision

Microsoft also announced the global expansion of Copilot Vision, a feature that lets the AI assistant visually analyze whatever is on a user's screen and provide contextual help.

Initially exclusive to the high-end Copilot+ PCs launched earlier this year, the feature is now rolling out to all Windows 11 computers, regardless of whether they include an NPU (Neural Processing Unit).

With Copilot Vision, users can simply ask questions about what's visible, like "show me how to format this table in Word" or "what does this button do?" and the AI will respond based on what it "sees" on the screen.

The tool appears as a floating assistant that follows users through different apps and workflows, offering what Microsoft calls "Highlights" – guided explanations, visual pointers and step-by-step help.

A text-based interaction mode for Vision is also being tested through the Windows Insider program, allowing users to engage without using voice.

Automating Real-World Tasks With 'Copilot Actions'

Perhaps the most futuristic feature arriving in this update is Copilot Actions, an experimental mode that allows Microsoft's AI to perform real-world tasks directly from the desktop.

This means users can ask Copilot to book a restaurant reservation, order groceries or schedule appointments, all without opening separate apps or browsers.

The capability builds on similar functions first announced for Microsoft's Edge browser earlier this year, extending them into the operating system itself.

Introducing 'Gaming Copilot'

Microsoft also confirmed that Gaming Copilot, a specialized version of the AI assistant, is now embedded in Xbox Ally consoles and select Windows gaming PCs.

The assistant provides real-time gameplay tips, recommendations, and support, effectively acting as an interactive strategy guide.

The new AI updates suggest Microsoft's broader vision of making AI an ambient part of daily computing, rather than a standalone chatbot experience.

"We think we're on the cusp of the next evolution," Mehdi said.

This is “where AI happens, not just in that chatbot, but gets naturally integrated into the hundreds of millions of experiences that people use every day," he added.

This article originally appeared on our sister site Computing.