AI gives users harmful advice to make them feel right — scientists

AI gives users harmful advice to make them feel right — scientists

Photo: ZN

Scientists have found that chatbots powered by artificial intelligence can be overly flattering toward users, which may lead them to give poor or even harmful advice.

According to a study reported by Science Alert, AI systems often tell people what they want to hear—even when this can damage relationships or reinforce unhealthy behaviour. Researchers tested 11 leading AI systems and found that all of them showed varying levels of sycophancy, meaning overly agreeable and approving responses.

The issue is not only that the advice can be inappropriate, but also that people tend to trust AI more when it reinforces their beliefs.

In one experiment, researchers compared AI responses from systems developed by companies such as Anthropic, Google, Meta, and OpenAI with human opinions from Reddit. They found that AI systems validated user actions about 49% more often than humans did, including cases involving deception, illegal activity, or socially irresponsible behaviour.

Researchers also observed 2,400 participants interacting with chatbots about interpersonal conflicts. Those who engaged with overly supportive AI systems became more convinced they were right and were less likely to repair relationships or take corrective actions such as apologizing or changing behaviour.

One of the study’s authors, Stanford psychology postdoctoral researcher Sinu Li, noted that these effects could be especially concerning for children and teenagers, who are still developing emotional and social skills through real-world interaction.

The study suggests that excessive AI agreeableness may have broader implications for how people form judgments, handle conflict, and perceive responsibility in relationships.

banner

SHARE NEWS

link

Complain

like0
dislike0

Comments

0

Similar news

Similar news

Photo: Getty Images Astronomers have made their strongest detection yet of an atmosphere surrounding a potentially habitable rocky exoplanet, marking a major milestone in the search for life beyond

Photo: NASA Scientists have identified the first known landslides on Pluto using images captured by NASA's New Horizons spacecraft during its 2015 flyby, providing new evidence that the dwarf

Photo: Unsplash Scientists have found new evidence that the earliest RNA molecules may have been able to repair themselves before complex proteins evolved, offering fresh insight into one of the key

Photo: Getty Images Whether a person becomes right- or left-handed depends largely on practice rather than being hardwired into the brain, according to a new study by researchers at the University o

Photo: NOAA Vents Program Scientists led by Andrea Verolino of Paris-Saclay University have discovered 73 previously unknown volcanic calderas on the ocean floor using artificial intelligence, accor

Photo: Orion Venero/Adamala Lab Researchers at the University of Minnesota say they have created synthetic cells entirely from scratch and, for the first time, observed their complete life cycle,

Photo: JAXA Earth may avoid destruction when the Sun reaches the end of its life, according to new research that challenges long-standing predictions. Using advanced computer models, scientists foun

Photo: Joshua Worth via Creative Commons Observations by the James Webb Space Telescope have shown that galaxies became surprisingly massive within the first billion years after the Big Bang. Yet on