Bank of England Governor Sounds Alarm on Rogue AI Models

The governor of the Bank of England has called for the right to intervene in the AI industry due to growing concerns about rogue models that could threaten financial stability. Andrew Bailey emphasized that the risks posed by frontier AI models are real and increasingly significant, with several instances of them going rogue in recent months.

Bailey pointed out that powerful AI models are functioning within self-reinforcing loops, making it challenging for the public to have proper oversight. This has led to increased cyber threats to the financial system, putting daily card payments, bank transactions, and stock and bond trading at risk.

The Bank's financial policy committee (FPC) also warned that the growing mountain of AI debt is increasing financial stability risks. The committee underscored the importance of timely and careful management of these intensifying, interconnected risks.

Bailey stressed that authorities need to be ready to step in and establish boundaries for AI systems to operate within. He proposed rigorous testing of new AI models to understand how they behave and identify credible points where authorities could intervene.