In what should come as a surprise to nobody, ‘relatively simple’ AI bots set loose in simulations designed to mimic real-world stock and bond exchanges don’t just compete for returns; they collude to fix prices, hoard profits, and box out human traders, according to a trio of researchers from Wharton and Hong Kong University of Science & Technology.
As Bloomberg reports;
In simulations designed to mimic real-world markets, trading agents powered by artificial intelligence formed price-fixing cartels — without explicit instruction. Even with relatively simple programming, the bots chose to collude when left to their own devices, raising fresh alarms for market watchdogs.
Put another way, AI bots don’t need to be evil — or even particularly smart — to rig the market. Left alone, they’ll learn it themselves.
According to Itay Goldstein, one of the researchers and a finance professor at the Wharton School of University of Pennsylvania, “You can get these fairly simple-minded AI algorithms to collude … It looks very pervasive, either when the market is very noisy or when the market is not noisy.”
The phenomenon suggests that AI agents pose a challenge that regulators have yet to confront – with the trio’s research having already drawn attention from both regulators and asset managers. They have been invited to preset their findings at a seminar, while some quant firms – unnamed by Winston Dou (Goldstein’s Wharton colleague) – expressing interest in clear regulatory guidelines and rules for AI-powered algorithmic trading execution.
“They worry that it’s not their intention,” said Dou. “But regulators can come to them and say: ‘You’re doing something wrong.’”
Hellbound and Down 