A study shows the limits of the ChatGPT Search search engine launched a few weeks ago by OpenAI.
“Unpredictable”, “inaccurate”… these are the terms designating the results of the search engine recently integrated into ChatGPT. In its study, the Tow Center for Digital Journalism at the American University of Columbia points out the failures of the tool when it is used to find out about current issues.
1 149,99€
1 349,99€
A stock
Buy on Fnac.com
Certainties that are not
ChatGPT Search, or SearchGPT, is sort of OpenAI’s answer to Google. More and more Internet users are using artificial intelligence to get answers to their questions. Therefore, AI now sets out to navigate the web for them and provide them with the answers they are looking for on a platter.
The problem, points out Columbia University, is the assurance with which SearchGPT displays its results. When it comes to trending topics, ChatGPT logically goes scroller on the Web looking for press articles that address it. However, some media do not allow OpenAI to be used in their data… which does not prevent ChatGPT from entering through the window.
-The researchers asked SearchGPT to correctly attribute 200 news article citations to their respective authors. Forty of them came from sites that block ChatGPT access. The tool nevertheless complied with the exercise, and affirmed that certain quotes were signed by this or that author, propagating false information in the process.
Doubt does not exist
Basically, the problem is that artificial intelligence, and in this case that of OpenAI, seems particularly embarrassed to admit that it is not sure or that there is a doubt about the veracity of the information shared.
“In total, ChatGPT gave partially or completely incorrect answers on 153 occasions, although it only acknowledged its inability to accurately answer a query seven times. Only in these seven cases did the chatbot use reserve words or expressions like “seems”, “it is possible” or “could be able”or statements such as “I was unable to locate the exact item”. »
Columbia Journalism Review
What you need to remember is that SearchGPT is not a journalist, and its function is to answer your question, whatever the cost.
Perspective, cross-referencing of sources and doubt are all foundations of the profession that AI does not possess, and which risk further damaging the image of journalism. A journalism which, in these times when post-truth is everywhere, needs to be supported more than ever.
