As part of its digital advent calendar, “twelve days of OpenAI”, which notably unveiled a new subscription and the deployment of the Sora video generator for the general public, the American company announced, on Thursday, a major development for ChatGPT. The famous chatbot is indeed enriched with real-time vision, a skill promised for more than seven months. Integrated into advanced voice mode, this functionality allows generative AI to visually analyze the environment and objects therein via a smartphone camera. She can thus answer questions about them.
In addition to video, the advanced voice mode, which also features Santa’s voice, also supports screen sharing. During their natural exchanges with the chatbot, the user can show the applications present on the screen of their device to request assistance or resolve problems, for example.
This new feature, powered by OpenAI’s 4o multimodal language model, is deployed in the ChatGPT mobile application for ChatGPT Teams, Plus and Pro subscribers. Users based in Europe are not yet eligible, however, but OpenAI is already planning to extend it to Plus and Pro subscribers in EU countries, Switzerland, Liechtenstein, Iceland and Norway. As for users of the Enterprise and Edu offers, they will have to wait until January to be able to access this functionality.
