By Adam Conner-Simons
It’s no secret that the last few years have seen a massive explosion in the use of artificial intelligence for general information-gathering. An even more recent trend, though, is how large language models (LLMs) like ChatGPT, Claude, and Gemini are increasingly being used for verifying and consuming news; reports from the Pew Research Center over the last year found that one-in-five U.S. teens regularly use LLMs to get their news, while one-in-four young adults have reported using them for that purpose at least once.
In the new Media Lab study, which tracked 67 people over four weeks as they evaluated news headline-image pairs, participants were 21 percent more accurate in detecting fake news when assisted by an AI chatbot during a session — confirming previous research out of the MIT Sloan School of Management demonstrating that AI can be an effective tool in reducing people’s beliefs in false information.
“Users get excited about these ‘magical’ LLMs, but forget that they’re just statistical models that predict the next ‘token’ in a sequence [of letters/words],” says MIT media arts and sciences (MAS) PhD student Anku Rani, co-lead author of a new paper about the research, alongside fellow MAS PhD student Valdemar Danry. “Many impressive behaviors emerge from scaling this, but it comes with real limitations, both in what the model can reliably generate and in its broader impact on the people using it.”
The paper, which Danry and Rani presented at the 2026 CHI Conference on Human Factors in Computing Systems, was co-authored by Assistant Professor Paul Pu Liang, Senior Research Scientist Andrew Lippman, and senior author Pattie Maes, the Germeshausen Professor of Media Arts and Sciences.