24/7 Space News
ROBO SPACE
AI risks 'disaster' without 'cast-iron guarantees': expert
AI risks 'disaster' without 'cast-iron guarantees': expert
By Kilian FICHOU
Paris (AFP) Feb 6, 2025

Artificial intelligence (AI) systems must come with "cast-iron guarantees" against mass harm to humans, especially as the likelihood of their integration into weapons grows, a leading expert has told AFP.

Stuart Russell, Berkeley computer science professor and co-director of the International Association for Safe and Ethical AI (IASEAI), will be in Paris Thursday for scientific talks in the run-up to a global summit on AI technology on February 10-11.

US tech giant Google appears to have walked back its commitment to avoid working on AI-powered weapons and surveillance systems. What was your reaction?

Stuart Russell: I think it's unfortunate. The reason they instantiated their earlier policy against the use of AI in weapons was precisely because their own employees revolted... The Google employees were worried that their work would be used in weapons, not just for reconnaissance, but for killing people.

Now (Google) says they're willing to override the views of their employees, also the views of the vast majority of the public, who are also opposed to the use of AI in weapons.

Why might Google have made this change?

SR: The military market for AI is minuscule compared to the consumer market and the business market so this is not really about the opportunity to make money. This is really about improving their bargaining position with the US government.

It's not a coincidence that this change in policy comes with a new administration that has removed all the regulations on AI that were placed by the Biden administration and is now placing a huge emphasis on the use of AI for military prowess.

What are the main dangers of using AI in weapons?

SR: Small autonomous weapon systems... are the most dangerous in the sense that because they're small and cheap, non-state groups, terrorists, for example, can buy them by the million and use them to carry out enormous massacres.

(Such weapons) could be used in much more dangerous and harmful ways. For example, "kill anyone who fits the following description". And that description could be by age, by gender, by ethnic group, by religious affiliation, or even a particular individual.

Will AI be increasingly integrated into future weapons systems?

SR: There were, at last count, about 75 countries that had either developed or were using remotely piloted weapons. And I think most of those are in the process of thinking about how to convert them to fully autonomous weapons.

Ukraine has been an accelerator... that conflict has forced these weapon systems to evolve very quickly. And everyone else is looking at this.

It's quite possible that the next major conflict after Ukraine will be fought largely with autonomous weapons in a way that is currently unregulated. So we can only imagine the kinds of devastation and horrific impacts on civilians that might occur as a result.

But on the other hand, there are more than 100 countries that have already stated their opposition to autonomous weapons. And I think there's a good chance that we'll achieve the necessary majority in the United Nations General Assembly to have a resolution calling for a ban.

Should AI in general be more tightly regulated?

SR: Human extinction could result from AI systems that are much more intelligent than humans, and therefore much more capable of affecting the world than we are.

Governments must require cast-iron guarantees in the form of either statistical evidence or mathematical proof that can be inspected, that can be checked carefully. And anything short of that is just asking for disaster.

kf/tgb/jxb

GOOGLE

Related Links
All about the robots on Earth and beyond!

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
ROBO SPACE
MIT engineers help multirobot systems stay in the safety zone
Boston MA (SPX) Feb 04, 2025
Drone shows are an increasingly popular form of large-scale light display. These shows incorporate hundreds to thousands of airborne bots, each programmed to fly in paths that together form intricate shapes and patterns across the sky. When they go as planned, drone shows can be spectacular. But when one or more drones malfunction, as has happened recently in Florida, New York, and elsewhere, they can be a serious hazard to spectators on the ground. Drone show accidents highlight the challenges of ... read more

ROBO SPACE
Momentus to conduct multi sensor rendezvous trial with US Air Force

Crew Wraps Spacewalk Duties and Expands Crop Research in Orbit

Will the US get to Mars quicker if it drops or delays plans to visit the Moon?

Spacewalkers Complete Radio Hardware Removal and Microbe Search

ROBO SPACE
Ride completes Deep Blue mission marking new chapter in satellite launch services

European Partners Expand Ariane 6 Commitment with Arianespace

Caltech takes first steps toward lightsails that could reach distant star systems

SpaceX launches more Startlink satellites from California

ROBO SPACE
Texas A&M scholar secures NASA funding to examine Martian dune dynamics

New Martian Crater Reveals Far-Reaching Seismic Signals

Approaching the Red Planet from the Kitchen

Explaining persistent hydrogen in Mars atmosphere

ROBO SPACE
Astronaut insights from mid mission aboard Tiangong

Chinese Satellite Companies Expand Global Services with Advanced Networks and Constellations

China launches additional satellites for Spacesail Constellation

Shenzhou XIX crew completes second spacewalk mission

ROBO SPACE
UK Gains Advanced Space Simulation Facility from Amentum

Vodafone utilizes US satellite array for milestone mobile call

SiriusXM's SXM-9 Satellite Begins Full Operation After Successful Testing

York Space Systems Expands Satellite Offerings with Enhanced M-CLASS Platform

ROBO SPACE
Alloy discovered that barely changes with temperature

Big Tech's AI spending rattles markets

Orbex lands D-Orbit deal prior to first mission this year

EdgeCortix unveils SAKURA-I with proven radiation immunity for orbital and lunar ventures

ROBO SPACE
Asteroid Bennu comes from a long-lost salty world with ingredients for life

IGRINS on Gemini South Detects Surprising Signatures in Dynamic Atmosphere of Exoplanet WASP-121b

PLATO mission set for late 2026 launch aboard Ariane 6

Dwarf planet Ceres has rare organic material delivered by asteroids

ROBO SPACE
NASA Juno Mission Discovers Record-Breaking Volcanic Activity on Io

SwRI models suggest Pluto and Charon formed similarly to Earth and Moon

Citizen scientists help decipher Jupiter's cloud composition

Capture theory unveils how Pluto and Charon formed as a binary system

Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.