New York Governor Kathy Hochul signed a law on Wednesday that prevents minors from using AI chatbots that act as companions. The measure is one of the broadest yet aimed at restricting consumer-facing AI models.
The law applies to chatbot operators, including OpenAI’s ChatGPT. Operators must verify users’ ages and restrict certain traits of the AI interface for anyone under 18.
What the New York law requires from chatbot operators
If a minor uses a chatbot, the bot may not produce content that could lead the user to believe it “is human, alive, or experiences human emotions,” the law states. It also cannot suggest a “personal relationship, professional relationship, or an authority figure role,” or present its output as a “personal opinion.”
Speaking at a signing ceremony, Hochul said minors would no longer have access to chatbots that “pretend to be their friends, boyfriends and girlfriends.” She added that chatbots would no longer be able to keep sensitive information about a minor’s emotional and physical health.
Industry criticism and backing from advocacy groups
Other US states, including California, have passed laws restricting chatbots. However, the New York law uses some of the broadest language on the technology, which has prompted backlash from AI companies.
Tech:NYC, a tech industry advocacy group in New York, criticised the “vague language” of the law. In a statement, the group said keeping children safe online should not mean cutting them off from tools that help them learn and prepare for careers.
OpenAI and Anthropic did not respond to requests for comment on the law. Common Sense Media, a nonprofit that advises parents on children’s media suitability, welcomed the bill’s passage. It called the measure “the strongest kids’ AI safety bill in the country.”
Common Sense Media CEO Jim Steyer said in a statement that some AI chatbot features are dangerous, and even deadly, for kids and teens. He said those features would now be outlawed in New York.
