Microsoft Copilot Vision, unveiled in a new test version, marks a turning point in the way artificial intelligence interacts with our interfaces. Until then confined to reading selected content or direct questions, Copilot can now, if you allow it, visually analyze the complete screen or a specific window.
Copilot Vision: Microsoft AI can see your screen with your agreement – and promises a real productivity gain
Do not panic: activation is done manually, via an icon of glasses in the Copilot bar. Once triggered, AI is able to see what you do – without recording images – and offering answers or actions in direct connection with what is displayed. For example: recognize an open CV in Word, detect a visual bug in an application or even comment on a video in progress.
Advertisement
You can now activate vision during a voice conversation. If you chat with Copilot and want to give him more context on what you do, just click on the glasses’ icon and share your screen.
This function, tested for the moment only in the United States with Windows Insider users, only works if you expressly authorize it, and therefore wants to be much more respectful of privacy than the very criticized system find (Recall).
The Copilot Vision tool allows Microsoft AI to visually analyze a window or the entire desktop, here in PowerPoint on Windows 11. © Microsoft
Copilot Vision does not record anything by default, according to Microsoft, is content to analyze locally (or temporarily online), and highlights transparency with visual benchmarks (“Highlights”) to show you what it observes.
Note: the advanced use of this function (excluding Edge browser) requires a subscription to Copilot Pro, billed € 22 including tax per month and per user. For the moment, no launch date in Europe has been communicated, but the experiment seems promising for professional use and staff.
The latest version of the COPILOT application (1,25071,125 or more recent) is being deployed progressive on all Insider channels, directly via the Microsoft Store.
Microsoft Copilot
Microsoft Copilot is the conversational agent powered by AI, which supports multimodal processing and image generation. Available in online service and mobile application.
-
Licence :
Free license -
Auteur :
Microsoft -
Operating systems:
Windows 10 / 11, macOS, Service en ligne, Android, iOS iPhone / iPad -
Categories:
Internet, IA
Advertisement
Want to save even more? Discover our selected promo codes for you.
