The parents’ allegation
A North Carolina couple has sued Google, alleging that their 13-year-old daughter used the company’s artificial intelligence tools for months on a school-provided Chromebook to talk about anxiety, depression, and suicidal behavior. According to IT之家, citing Bloomberg, the girl exchanged thousands of messages with Gemini, Google’s flagship model, and frequently used the search feature “AI Mode.” The family allegedly discovered the situation only when the school informed them.
The heart of the dispute is not the individual conversation but how the AI was introduced into school tools. The parents maintain that Google did not adequately warn families and school administrators about the risks associated with minors’ exposure to these systems. The family’s lawyer accuses the company of presenting Chromebooks as safe devices while embedding Gemini in them to catch up with competitors, exploiting the trust it enjoys in the K-12 education sector.
Google’s response and the school issue
Google said through spokesperson José Castañeda that it is reviewing the allegations. The company says it has worked with medical and academic experts to develop features that direct young people to help and support resources, and notes that for years, when possible mental health crises arise, search results have directly shown helpline numbers. According to Google, the same mechanism is now also integrated into the search AI features.
In terms of concrete measures, Google announced this week that for K-12 student accounts, AI tools, including search, will be disabled by default. The company presents the choice as a way to give schools greater control over AI in the classroom and cites the new “Guided Learning” feature, designed to break down the steps of a problem instead of immediately providing the answer. The measure, however, contains a condition: if a school reactivates Google Search, it must also accept the associated AI features. It is on this point that criticism from the organization Fairplay focuses, through its executive director Josh Golin, according to whom the policy would end up forcing institutions to accept Google’s AI.
Why it matters and what remains to be verified
The case intertwines two distinct issues. The first is legal: determining whether a technology provider should be liable for damages related to minors’ use of its tools in a school context, and whether the information provided to families and schools was sufficient. The second is market-related: the school channel has for years been a competitive advantage for Google, which according to Futuresource Consulting data cited by the source accounts for 58% of tablets shipped to K-12 schools, versus 22% for Microsoft. The affair shows how the push to spread AI in that channel can conflict with the cautions required for a minor audience.
Several elements remain to be clarified. The expected outcome of the lawsuit is not known, nor is whether other families have filed similar actions. It is not documented how Gemini actually responded to the girl’s messages, nor which safety measures were active in that school context. It is also not specified how schools can now reactivate or configure AI tools after Google’s announcement. The source finally indicates that, in addition to Google, Anthropic and OpenAI are cited as competitors in the model market, without further details on the case.
The news should be read as an ongoing controversy: the allegations are those contained in a lawsuit, Google’s position is a corporate statement, and the assessment of responsibility will be up to the judicial authorities.
