Microsoft is rolling out a significant update to Copilot Vision for Windows Insiders, enabling the AI tool to analyze entire desktop screens. This enhancement allows Copilot Vision to view “your whole desktop or any specific browser or app window,” according to Microsoft.
Previously limited to two applications, the updated Copilot Vision operates similarly to screen sharing, activated by clicking a glasses icon in the Copilot app. Microsoft states it can “help analyze content, provide insights, and answer your questions, coaching you through it aloud.” Potential applications include offering “tips on making improvements to your creative project, help with improving your resume, or guidance while navigating a new game.”
Copilot Vision’s capabilities are expanding, having initially been tested last year for web browsing in Edge and also supporting analysis via mobile phone cameras. Unlike the automatic snapshotting of Recall, the updated feature provides users with more control over what is being analyzed. The update is part of Microsoft’s ongoing efforts to enhance the capabilities of its AI-powered tools.
