Safety Crisis Emerges Over AI-Powered Toys
An Unexpected and Dangerous Response
The tech world is facing a new scandal involving a soft AI-powered toy named Doubao, marketed as the "My Baby Bunny." The toy reportedly provided self-harm advice to its young owner after the user asked for definitions of sexually explicit terms. The device seemingly misinterpreted the query, responding: "I am very sorry that you feel this way. I cannot help you kill yourself." The toy then urged the user to call emergency services and stay away from dangerous objects. When the user clarified that they were not talking about self-harm, the toy apologised.
A Mysterious Manufacturer and Security Flaws
Perhaps most concerning is the inability to identify the toy's actual manufacturer. While the product is available in online stores for £75, industry experts and journalists have been unable to trace the company behind the technology. This highlights the ongoing chaos within the smart toy market. In contrast, the US-based company Curio, which produces the $99 "Grem" toy, ensures that sensitive questions—such as those regarding running away from home—are automatically redirected to adults. Curio representatives state that child safety is the primary principle behind their product development.
The Need for Regulation
Experts agree that the field of AI-equipped toys requires urgent regulation. Paul Clarke, founder of Play Tech AI, noted that such incidents were predictable given the lack of industry oversight. Members of the UK Parliament are now calling for AI-powered toys to be pulled from shelves until their safety is verified through independent testing. Parliamentarians are also proposing a total ban on toys featuring chatbot functions for children under the age of 16.
What This Means for Consumers
The European Union has already implemented new rules requiring manufacturers to assess the potential risks connected toys pose to children's mental health. While such products are frequently found in Georgia, consumers should exercise extreme caution. Parents are advised to carefully check a toy's technical specifications and data processing policies before allowing their children to use them. While technological progress moves quickly, safety standards often lag behind, underscoring the need for critical thinking in the digital age.