Microsoft Sets New AI Safety Standards in Schools Amid Backlash

Microsoft has agreed to sweeping AI privacy rules for students as part of an agreement with the American Federation of Teachers, the country's second-largest teachers union. The new standards aim to protect student data from being used to train AI systems and ensure that schools have control over their education. Under the terms of the agreement, Microsoft will not use student or educator data to train its AI systems, except in cases where it could help protect students.

The agreement also prohibits the use of AI companions or features designed to foster emotional attachment or dependency, as well as measures to keep students engaged for longer than a learning task requires. Microsoft has committed to third-party audits for compliance and will disclose how its tools work to families in plain language.

The new standards have been hailed by educators and experts in data privacy as an important step towards setting industry-wide benchmarks for AI safety and privacy in schools. However, concerns remain that other tech giants may not follow suit, with Google still refusing to comment on whether it plans to offer similar protections.