A California lawmaker has launched a first-in-the-nation invoice meant to ban firms from embedding AI chatbot know-how into toys designed for youngsters. Introduced on Friday, the measure comes amid rising issues in regards to the influence of artificial intelligence on youngster welfare, in addition to various native and federal proposals to restrict children’ entry to massive language mannequin (LLM) chatbots.
This specific laws would goal toys that simulate friendship and companionship via LLM know-how. For toy producers, LLMs can present a straightforward, albeit dangerous, approach of making a persona for a specific doll or character. AI fashions aren’t pre-scripted the way in which most speaking toys are—which suggests toys built-in with the tech can find yourself sharing all kinds of inappropriate content material with a younger youngster. Working example: Gross sales for an AI-enabled teddy bear had been suspended in November after the toy, when investigated, began speaking about sexual role-play and igniting matches.
The California invoice, authored by state Sen. Steve Padilla, is designed as a moratorium and would ban, till a minimum of January 1, 2031, the sale of toys that embrace a “companion chatbot” meant for youngsters 12 and youthful.
The proposal defines a companion chatbot as “a man-made intelligence system with a pure language interface that gives adaptive, human-like responses to consumer inputs and is able to assembly a consumer’s social wants.” The invoice additionally targets chatbot know-how designed to assist an ongoing bond with a possible youngster, “together with by exhibiting anthropomorphic options and with the ability to maintain a relationship throughout a number of interactions.”
“Chatbots and different AI instruments might turn into integral elements of our lives sooner or later, however the risks they pose now require us to take daring motion to guard our youngsters,” Padilla mentioned in an announcement. “Our security laws round this sort of know-how are of their infancy and might want to develop as exponentially because the capabilities of this know-how does. … Our kids can’t be used as lab rats for Huge Tech to experiment on.”
It’s not instantly clear whether or not the invoice has legs. However the influence of synthetic intelligence on children has outraged native and federal lawmakers on either side of the aisle. One bipartisan federal proposal from Sen. Josh Hawley (R-MO) and Sen. Richard Blumenthal (D-CT), as an example, would ban using AI companions for minors and punish AI firms that make AI for minors that solicits or produces sexual content material.
Notably, the White Home has pushed again on state lawmakers hoping to control AI know-how. Late final yr, President Donald Trump signed an executive order that will goal states that write their very own legal guidelines with litigation, and take a sequence of steps to ascertain one nationwide method to AI regulation on matters like youngster security and alleged censorship. For now, although, it’s not clear how critical the Trump administration’s efforts really are.
Representatives for a number of organizations targeted on digital welfare for teenagers didn’t reply to a request for touch upon the laws, which was launched Friday, January 2.

