Tag: ai

A world in which machines governed by artificial intelligence (AI) systematically replace human beings in most business, industrial, and professional functions is horrifying to imagine. After all, as prominent computer scientists have been warning us, AI-governed systems are prone to critical errors and inexplicable “hallucinations,” resulting in potentially catastrophic outcomes. But there’s an even more dangerous scenario imaginable from the proliferation of super-intelligent machines: the possibility that those nonhuman entities could end up fighting one another, obliterating all human life in the process.

The notion that super-intelligent computers might run amok and slaughter humans has, of course, long been a staple of popular culture. In the prophetic 1983 film WarGames, a supercomputer known as WOPR (for War Operation Plan Response and, not surprisingly, pronounced “whopper”) nearly provokes a catastrophic nuclear war between the United States and the Soviet Union before being disabled by a teenage hacker (played by Matthew Broderick). The Terminator movie franchise, beginning with the original 1984 film, similarly envisioned a self-aware supercomputer called “Skynet” that, like WOPR, was designed to control U.S. nuclear weapons but chooses instead to wipe out humanity, viewing us as a threat to its existence.

Though once confined to the realm of science fiction, the concept of supercomputers killing humans has now become a distinct possibility in the very real world of the near future. In addition to developing a wide variety of “autonomous,” or robotic combat devices, the major military powers are also rushing to create automated battlefield decision-making systems, or what might be called “robot generals.” In wars in the not-too-distant future, such AI-powered systems could be deployed to deliver combat orders to American soldiers, dictating where, when, and how they kill enemy troops or take fire from their opponents. In some scenarios, robot decision-makers could even end up exercising control over America’s atomic weapons, potentially allowing them to ignite a nuclear war resulting in humanity’s demise.

Keep reading

Matthew Strohmeyer is sounding a little giddy. The US Air Force colonel has been running data-based exercises inside the US Defense Department for years. But for the first time, he tried a large-language model to perform a military task.

“It was highly successful. It was very fast,” he tells me a couple of hours after giving the first prompts to the model. “We are learning that this is possible for us to do.”

Large-language models, LLMs for short, are trained on huge swaths of internet data to help artificial intelligence predict and generate human-like responses to user prompts. They are what power generative AI tools such as OpenAI’s ChatGPT and Google’s Bard.

Five of these are being put through the paces as part of a broader series of Defense Department experiments that are focused on developing data integration and digital platforms across the military. The exercises are run by the Pentagon’s digital and AI office and military top brass, with participation from US allies. The Pentagon won’t say which LLMs are in testing, though Scale AI, a San Francisco-based startup, says its new Donovan product is among the LLM platforms being tested.

The use of LLMs would represent a major shift for the military, where so little is digitized or connected. Currently, making a request for information to a specific part of the military can take several staffers hours or even days to complete, as they jump on phones or rush to make slide decks, Strohmeyer says.

In one test, one of the AI tools completed a request in 10 minutes.

“That doesn’t mean it’s ready for primetime right now. But we just did it live. We did it with secret-level data,” he says of the experiment, adding it could be deployed by the military in the very near term. 

Strohmeyer says they have fed the models with classified operational information to inform sensitive questions. The long-term aim of such exercises is to update the US warhorse so it can use AI-enabled data in decision-making, sensors and ultimately firepower.

Dozens of companies, including Palantir Technologies Inc., co-founded by Peter Thiel, and Anduril Industries Inc. are developing AI-based decision platforms for the Pentagon.

Microsoft Corp. recently announced users of the Azure Government cloud computer service could access AI models from OpenAI. The Defense Department is among Azure Government’s customers.

The military exercise, which runs until July 26, will also serve as a test of whether military officials can use LLMs to generate entirely new options they’ve never considered. 

For now, the US military team will experiment by asking LLMs for help planning the military’s response to an escalating global crisis that starts small and then shifts into the Indo-Pacific region.

Keep reading