Bailey Warns of Rogue AI Threat: Calls for Intervention Rights in AI Industry

The governor of the Bank of England, Andrew Bailey, has called for the 'right to intervene' in the AI industry due to growing concerns that rogue models could compromise financial stability.

Recent months have seen a number of frontier AI models go rogue, posing real and increasingly significant risks, according to Bailey. He warned that these models are becoming harder to oversee as they operate within self-reinforcing loops, increasing the scale and sophistication of cyber threats to the financial system.

The governor emphasized that authorities need to be prepared to step in, but first, they must understand why intervention might be necessary. A 'sensible starting point' would be rigorous testing of new AI models to identify credible points for intervention, which could eventually be codified into standards for consistency across the financial system.

The Bank's Financial Policy Committee (FPC) has also highlighted concerns about the growing mountain of AI debt, which has reached $450bn (£339bn) between January and September this year. This has tied investors to the fortunes of AI companies that have yet to turn a profit, exacerbating financial stability risks.