AI chatbot firms face stricter regulation in online safety laws protecting children in the UK

AI chatbot firms face stricter regulation in online safety laws protecting children in the UK


Preteen girl at desk solving homework with AI chatbot.

Phynart Studio | E+ | Getty Images

The UK government is closing a “loophole” in new online safety legislation that will make AI chatbots subject to its requirement to combat illegal material or face fines or even being blocked.

After the country’s government staunchly criticized Elon Musk’s X over sexually explicit content created by its chatbot Grok, Prime Minister Keir Starmer announced new measures that mean chatbots such as OpenAI’s ChatGPT, Google’s Gemini, and Microsoft Copilot will be included in his government’s Online Safety Act.

The platforms will be expected to comply with “illegal content duties” or “face the consequences of breaking the law,” the announcement said.

This comes after the European Commission investigated Musk’s X in January for spreading sexually explicit images of children and other individuals. Starmer led calls for Musk to put a stop to it.

Keir Starmer, UK prime minster, during a news conference in London, UK, on Monday, Jan. 19, 2026.

Bloomberg | Bloomberg | Getty Images

Earlier, Ofcom, the UK’s media watchdog, began an investigation into X reportedly spreading sexually explicit images of children and other individuals.

“The action we took on Grok sent a clear message that no platform gets a free pass,” Starmer said, announcing the latest measures. “We are closing loopholes that put children at risk, and laying the groundwork for further action.”

Starmer gave a speech on Monday on the new powers, which extend to setting minimum age limits for social media platforms, restricting harmful features such as infinite scrolling, and limiting children’s use of AI chatbots and access to VPNs.

One measure announced would force social media companies to retain data after a child’s death, unless the online activity is clearly unrelated to the death.

“We are acting to protect children’s wellbeing and help parents to navigate the minefield of social media,” Starmer said.

Alex Brown, head of TMT at law firm Simmons & Simmons, said the announcement shows how the government is taking a different approach to regulating rapidly developing technology.

“Historically, our lawmakers have been reluctant to regulate the technology and have rather sought to regulate its use cases and for good reason,” Brown said in a statement to CNBC.

He said that regulations focused on specific technology can age quickly and risk missing aspects of its use. Generative AI is exposing the limits of the Online Safety Act, which focuses on “regulating services rather than technology,” Brown said.

He said Starmer’s latest announcement showed the UK government wanted to address the dangers “that arise from the design and behaviour of technologies themselves, not just from user‑generated content or platform features,” he added.

There’s been heightened scrutiny around children and teenagers’ access to social media in recent months, with lawmakers citing mental health and wellbeing harms. In December, Australia became the first country to implement a law banning teens under 16 from social media.

Australia’s ban forced apps like Alphabet’s YouTube, Meta’s Instagram, and ByteDance’s TikTok to have age-verification methods such as uploading IDs or bank details to prevent under-16s from making accounts.

Spain became the first European country to enforce a ban earlier this month, with France, Greece, Italy, Denmark, and Finland also considering similar proposals.

The UK government launched a consultation in January on banning social media for under-16s.

Additionally, the country’s House of Lords, an unelected upper legislative chamber, voted last month to amend the Children’s Wellbeing and Schools Bill to include a social media ban for under-16s.

The next phase will see the bill reviewed by parliament’s the House of Commons. Both houses have to agree on any changes before they pass into law.



Source

Major data center company pauses investment decisions in Middle East amid Iran war, CEO tells CNBC
Technology

Major data center company pauses investment decisions in Middle East amid Iran war, CEO tells CNBC

A major data center company has paused investment in AI infrastructure projects and data centers in the Middle East amid the Iran war, its CEO has told CNBC. As oil prices have skyrocketed and supply chains have been heavily disrupted by conflict in the region, the future of huge digital infrastructure plans in the Middle […]

Read More
Can AI outperform doctors? Experts weigh the pros and cons
Technology

Can AI outperform doctors? Experts weigh the pros and cons

Cravetiger | Moment | Getty Images You may already be familiar with AI taking notes in your doctor’s office, or being used to help book appointments or analyze medical images. But some experts believe consumers should be using AI even more to help understand their health. “People should be using AI much more than they […]

Read More
Jim Cramer is unfazed by Tuesday’s sell-off: ‘You should expect them, even hope for them’
Technology

Jim Cramer is unfazed by Tuesday’s sell-off: ‘You should expect them, even hope for them’

CNBC’s Jim Cramer said he’s unfazed by Tuesday’s sell-off in AI stocks because it’s exactly what the market needs. “Rain is to gardening as sell-offs are to the stock market,” the “Mad Money” host said. “You should expect them, maybe even hope for them. We just don’t realize it at the time.” Stocks retreated on […]

Read More