AI gives users harmful advice to make them feel right — scientists

AI gives users harmful advice to make them feel right — scientists

Photo: ZN

Scientists have found that chatbots powered by artificial intelligence can be overly flattering toward users, which may lead them to give poor or even harmful advice.

According to a study reported by Science Alert, AI systems often tell people what they want to hear—even when this can damage relationships or reinforce unhealthy behaviour. Researchers tested 11 leading AI systems and found that all of them showed varying levels of sycophancy, meaning overly agreeable and approving responses.

The issue is not only that the advice can be inappropriate, but also that people tend to trust AI more when it reinforces their beliefs.

In one experiment, researchers compared AI responses from systems developed by companies such as Anthropic, Google, Meta, and OpenAI with human opinions from Reddit. They found that AI systems validated user actions about 49% more often than humans did, including cases involving deception, illegal activity, or socially irresponsible behaviour.

Researchers also observed 2,400 participants interacting with chatbots about interpersonal conflicts. Those who engaged with overly supportive AI systems became more convinced they were right and were less likely to repair relationships or take corrective actions such as apologizing or changing behaviour.

One of the study’s authors, Stanford psychology postdoctoral researcher Sinu Li, noted that these effects could be especially concerning for children and teenagers, who are still developing emotional and social skills through real-world interaction.

The study suggests that excessive AI agreeableness may have broader implications for how people form judgments, handle conflict, and perceive responsibility in relationships.

banner

SHARE NEWS

link

Complain

like0
dislike0

Comments

0

Similar news

Similar news

Photo: president.gov.ua Ukraine has used the Fire Point-developed FP-7 tactical ballistic missile in combat for the first time, President Volodymyr Zelenskyy said on October 1. “Ukrainian tactical

Photo: Russian media Ukraine is using electronic warfare, combat aviation and newly developed interceptor drones to counter Russia's jet-powered Shahed attack drones. However, each method has li

Photo: depositphotos Ukraine’s State Migration Service has temporarily suspended the processing and issuance of passport documents from September 28 through September 30 because of a technical failu

Photo: EPA OpenAI has paused training of its latest artificial intelligence models amid a growing number of incidents involving AI agents behaving in unexpected ways, the company said. The decision

Photo: Getty Images China is providing Russia with new technologies for military drones, including systems that could allow drones to enter buildings and attack people inside, Ukrainian President Vo

Photo: EPA Nobel Prize-winning physicist and computer scientist Geoffrey Hinton , widely known as the “godfather of AI,” estimates the probability that artificial intelligence could cause the destr

Photo: Fire Point Patriot-class air-defense systems are too expensive and slow to produce for Europe and Ukraine to deploy them at the scale required. A pan-European project known as Freyja could

Photo: depositphotos Russia has sharply increased its use of jet-powered drones as part of a change in its attack tactics against Ukraine. Over the course of one month, the number of such UAVs used