New law restricts children’s use of AI chatbots, shocking reason revealed

The law was signed by New York Governor Kathy Hochul and requires chatbot operators, including OpenAI’s ChatGPT, to check users’ ages and apply special restrictions to minors.

What the new law prohibits

Under the New York AI chatbot law, systems used by children cannot produce content that makes them believe a chatbot “is human, alive, or experiences human emotions.” The law also prevents chatbots from suggesting that they have a personal or professional relationship with a minor or hold authority over them.

Chatbots must also avoid presenting their responses as a “personal opinion” when interacting with users under 18. These rules are designed to make it clearer to children that they are communicating with artificial intelligence rather than a real person.

Hochul says children need stronger protection

Governor Kathy Hochul said the law would prevent chatbots from presenting themselves as close companions to children. “No longer will minors have access to chatbots that pretend to be their friends, boyfriends and girlfriends,” she said at the signing ceremony.

Hochul also raised concerns about the handling of children’s sensitive information. “No longer will chatbots be able to keep sensitive information about a minor’s emotional and physical health,” she added.

Technology industry raises concerns

The law follows similar efforts in other US states, including California, to regulate AI chatbots used by children. However, its broad wording has raised concerns among technology companies and industry groups.

Tech, a technology industry advocacy group, criticised what it called the law’s “vague language”. “Keeping kids safe online should not mean cutting them off from tools that help them learn and prepare for careers,” the group said in a statement.

OpenAI and Anthropic did not respond to an AFP request for comment on the new law. The law is likely to add to the debate over how governments can protect children without limiting their access to useful AI tools.

Child safety groups welcome the move

Common Sense Media, a nonprofit organisation that advises parents on suitable media for children, welcomed the law. It described the legislation as “the strongest kids’ AI safety bill in the country.”

The organisation’s chief executive, Jim Steyer, said some chatbot features could put young users at risk. “AI companies offer chatbots with features that are dangerous, and even deadly, for kids and teens… Now, those harmful features will be outlawed in New York,” he said.

The law highlights growing concerns about children forming emotional attachments to AI chatbots. Its success will depend on how the rules are enforced and whether companies can protect young users without blocking helpful learning tools.

Also read: Lahore tops world’s most polluted major cities amid dangerous smog levels