• Login
  • Register

Work for a Member company and need a Member Portal account? Register here with your company email address.

Article

Will autonomous weapons make humans passive participants in war?

“The most dangerous AI isn’t the Terminator-type,” Pat Pataranutaporn, a technologist at MIT, said in an email. “Because its evil intent is obvious.” Rather, according to Pataranutaporn, an expert in human-AI interaction, “the real danger lies in AI that appears friendly but subtly manipulates our behaviour in ways that we can’t anticipate”.

In early August, he and a colleague wrote an essay describing the dangerous allure of “addictive intelligence” – systems that are simultaneously superior and submissive to their human operators.

And while Pataranutaporn’s research focuses on AI companions, similar risks surrounding the use of AWS by state and non-state actors are clear. This is especially true if computer models underpinning intelligent weapons advise or select for scorched earth tactics as the shortest path to victory.

Related Content