October 1st, 2024

Microsoft Copilot can now read your screen, think deeply, and speak aloud to you

Microsoft has launched new Copilot features, including Copilot Vision for screen content interpretation, Think Deeper for complex problem-solving, and Copilot Voice for spoken interaction, with personalization options forthcoming.

Read original articleLink Icon
Microsoft Copilot can now read your screen, think deeply, and speak aloud to you

Microsoft has introduced new capabilities for its Copilot AI across various platforms, including Windows, iOS, and Android. Notable features include Copilot Vision, which allows the AI to read and interpret content on users' screens, particularly in Microsoft Edge, and respond to queries about the displayed information. This feature is designed to prioritize user privacy by deleting data after use and is currently limited to specific websites. Another enhancement, Think Deeper, enables Copilot to tackle more complex problems by utilizing advanced reasoning models. Additionally, Copilot Voice has been launched, allowing users to interact with the AI through spoken commands, with responses also delivered audibly. Microsoft is also rolling out a personalization feature that tailors Copilot's suggestions based on user history, although this will not be available in the EU and UK for now. The company emphasizes its commitment to privacy and responsible AI use, especially in light of past legal challenges regarding data usage and paywalls.

- Microsoft has launched new Copilot features, including Copilot Vision, Think Deeper, and Copilot Voice.

- Copilot Vision can read and interpret screen content while prioritizing user privacy.

- Think Deeper enhances Copilot's ability to solve complex problems using advanced reasoning models.

- Copilot Voice allows for spoken interaction with the AI, with responses delivered audibly.

- Personalization features will be available soon, but not in the EU and UK initially.

Link Icon 2 comments
By @hulitu - 7 months
> Microsoft Copilot can now read your screen, think deeply, and speak aloud to you

Is it better than "MS narator" ?

By @allears - 7 months
"Think deeply?" How about just "come up with something plausible to say that may or may not be true?"