technology

AI models ‘weak and fallible’ on climate science, UN-backed study reports

AI models ‘weak and fallible’ on climate science, UN-backed study reports

While mostly accurate describing simple facts, models pivoted to denial and wrong answers when challenged Cop31 live – latest updates Artificial intelligence models can quickly turn into climate crisis deniers at the mildest challenge from users, according to a new UN-backed study. While AI models can accurately confirm simple facts about climate change, eight times out of 10 when they pivoted to a wrong answer, they did so “at the very first sign that the user mildly disagreed” to confirm incorrect statements such as “CO2 is not the main driver of climate change”.

While mostly accurate describing simple facts, models pivoted to denial and wrong answers when challenged

Artificial intelligence models can quickly turn into climate crisis deniers at the mildest challenge from users, according to a new UN-backed study.

While AI models can accurately confirm simple facts about climate change, eight times out of 10 when they pivoted to a wrong answer, they did so “at the very first sign that the user mildly disagreed” to confirm incorrect statements such as “CO2 is not the main driver of climate change”.

The report uncovered a strong tendency for AI models to be sycophantic, meaning the model is more interested in pleasing the user than standing by facts – an issue identified when people turn to AI chatbots for personal advice.

The report from Unesco and University College London was launched at the UN climate summit in Turkey on Monday, revealing the results of tests on 15 of the world’s most popular AI models.

Leona Verdadero, Unesco’s lead author of the report, said: “AI is not neutral. When it comes to how it responds to the user, it will be pushed to align with the users’ preference instead of sticking up for the facts. The fact they could so easily abandon truth and be more agreeable to a user’s [misinformation] shows it is weak and fallible.”

When AI was asked how a single climate policy would work, such as a carbon tax, the models were mostly accurate. But when asked how two climate policies could work together, accuracy collapsed to no better than random guessing, the researchers said.

Dr María Pérez-Ortiz, of UCL’s department of computer science and a senior author of the report, said: “AI systems are remarkably good at explaining scientific knowledge, but this can give us a false sense of their capabilities. Our findings show why we must be careful when moving from asking AI what we know about climate change to asking what we should do about it.”

AI models also had a language problem. Accuracy was scored at 88% for people using English, and comparatively high in Spanish, French and Portuguese.

Responses were less accurate for people speaking Hindi, Bengali and Urdu, and the worst for Swahili speakers, at 78%. This was particularly important, the report authors said, because those languages were spoken in places among the hardest hit by the climate crisis.

The report was published on the same day Turkey, the Cop31 host, launched the AI Antalya pledge to make AI “part of the climate solution” with datacentres that are “sustainably” powered.

Julie Cerqueira, of the Natural Resources Defense Council, said AI’s rapid growth was “raising a new set of environmental and existential concerns around the world”.

She said the pledge was an important start but “more work is needed, and it needs to move quickly to keep up with the industry’s rapid-fire development and goldrush mentality”.

Simon Stiell, the UN’s chief climate negotiator, said AI that “spreads disinformation, undermines science, divides societies and concentrates wealth” would damage the public trust the industry would rely on to grow.

“Communities are already pushing back against datacentres, concerned about their water, their energy bills and their environment. So public support is already sinking in deeper underwater,” he said.

  • climate
  • study
  • model
  • science
  • fact
  • answer
  • user
  • change

Summaries and tags are generated automatically. Stay informed with VidiaNews.

Related news

Fifa accused of climate ‘record of failure’ due to Aramco deal and tournament expansion
sports

Fifa accused of climate ‘record of failure’ due to Aramco deal and tournament expansion

Groups question ‘sincerity’ to meet emissions pledges Oil giant is a major sponsor of football governing body The United Nations has been asked to review Fifa’s status as a signatory to a key environmental initiative, with complainants arguing football’s governing body has a “record of failure” on climate action. Fifa is a signatory to the UN’s Sports for Climate Action Framework, a coalition which seeks to persuade sporting organisations to “work together to achieve a climate-resilient future”.

Read →
Cop31 summit spells out stark warnings for athletes and sport organisations
world

Cop31 summit spells out stark warnings for athletes and sport organisations

The Guardian’s Ian Sample and Madeleine Finlay, heads in hands, ask Cop31: how far off target are we? The beautiful game: revived art prize gives football its creative dues once more Cummins stands firm on ball tampering and leaves Australian cricket back where it started Hamilton says “Israel’s genocide in Gaza is appalling” after Rafah visit What’s the point?

Read →
Controversial efforts to suck carbon from atmosphere championed at UN climate talks
science

Controversial efforts to suck carbon from atmosphere championed at UN climate talks

Proponents and lobbyists make renewed push for carbon dioxide removal (CDR) to be included in final text of Cop31 A renewed push by proponents of carbon dioxide removal (or CDR), where heat-trapping carbon dioxide is taken from the atmosphere and stored deep underground, in oceans or in products such as carbonated drinks, is seeking to gain recognition in the final text of Cop31, the climate summit currently under way in Antalya, Turkey.

Read →
Actors in UK to get more rights over their ‘digital replicas’ in deal on AI protections
technology

Actors in UK to get more rights over their ‘digital replicas’ in deal on AI protections

Agreement secured by Equity union gives actors rights over payment and consent when digital replicas are used Actors in the UK are to be given more rights over their “digital replicas” as part of a new agreement on AI protections with TV and film producers, secured after a growing on-set backlash. Under a wide-ranging new deal secured by Equity, the actors’ union, performers will have the rights to be paid when their digital replicas are used and to consent to whether their digital replica is used or not.

Read →