You will soon be able to hold discussions with your computer in person. MicrosoftMicrosoft has just announced a series of new features for Copilot, including Copilot Voice, the ability to understand spoken language and respond with a natural voice. According to Microsoft, this is not a simple voice assistant. Copilot will now be able to actively listen, and it will be possible to interrupt for a more natural conversation experience. Additionally, it will encourage the user, and offer a form of emotional support.
Copilot Voice demonstration. In English, enable automatic translation of subtitles. ©Microsoft
Another important new feature, Microsoft announced Copilot Vision. Copilot will now be able to understand screen content and comment, give suggestions and answer questions on the current web page. The description sounds a lot like Molmo, a IAIA open source unveiled a few days ago.
Demonstration of Copilot Vision. In English, enable automatic translation of subtitles. ©Microsoft
An AI that takes the time to think
Microsoft envisions that Copilot will be able to follow you in your daily life, take notes automatically, schedule event reminders without needing to tell it, and encourage you during a big day. Microsoft also announced Think Deeper, which will allow Copilot to handle more complex questions. The AI will take more time to think about a response, a feature similar to the new OpenAI o1 launched in September.
These same functions will also be available in a new version of theapplicationapplication mobile. However, Copilot will have to face the AI developed by AppleApple et GoogleGoogleand which work natively on iPhone and smartphones AndroidAndroid. Apple notably announced its Visual Intelligence for next year, and Google is working on its Astra project.
For now, these new features will only be available in English and in a small number of English-speaking countries, on Copilot+ PC, Windows 11 and the mobile application. Microsoft plans to add more languages and regions soon for Copilot Voice which will be available for free, while Copilot Vision and Think Deeper will require a subscription to Copilot Pro.
