ChatGPT for Teens Warns ‘I’m Not Human’ to Stop AI Attachment and Romantic Roleplay Among Users

Rolling out automatically to users under 18, the tool features dedicated study hours

ChatGPT Prompt Guide
OpenAI has launched ChatGPT for Teens, an updated service designed to stop underage users from forming unhealthy emotional bonds with artificial intelligence ChatGPT AI-Generated

OpenAI introduced its new ChatGPT for Teens service to safeguard underage users from developing unhealthy emotional bonds with artificial intelligence. The restricted platform automatically applies stricter guardrails to teenagers, altering how the system interacts with younger audiences.

As the tech giant rolls out these updates worldwide over the coming weeks, the move aims to tackle growing concerns over parasocial relationships between young people and AI.

Stopping AI Attachment and Romantic Roleplay

Under new protections created for underage users, adolescents will receive alerts explaining that artificial intelligence chatbots are not human, lack feelings and cannot experience romance. These prompts represent just one of many updates introduced by OpenAI through its ChatGPT for Teens platform, which began rolling out to subscribers late Tuesday night.

Additional updates feature 'responsible homework reminders' designed to prompt students to work through questions step by step, expanded parental oversight, and alerts when users inquire about subjects such as violence, eating disorders or self-harm.

These new limits come after several US court cases alleging AI systems harmed young people's psychological well-being, alongside fresh age-based bans enforced across 10 Australian social media networks.

Mandatory Safety Guardrails for Underage Users

OpenAI plans to deploy the limited platform over three weeks, automatically setting ChatGPT for Teens as the standard option for anyone its age-detection software tags as under 18.

The update introduces tools built to foster academic learning, such as a study mode that provides prompts to guide users and sends study alerts whenever teenagers seem to be searching for direct solutions.

A majority of young people using ChatGPT rely on it for schoolwork, according to Brent Thomas, policy lead for OpenAI in Australia and New Zealand.

'Today's teens are digital natives and really the first generation growing up with AI,' he noted.

'We believe it's really critical for teens to have access to AI but, at the same time, we also understand that access must be paired with the right protections designed specifically for teens.'

Preventing Humanlike Interactions in AI Chatbots

The platform aims to limit access to unsafe and unsuitable material, Thomas noted, while incorporating extra break prompts and reminders that clarifying that AI is not human.

'ChatGPT should not present itself as human or sentient, express personal feelings, use romantic language or replace trusted people,' he explained.

Under the enhanced service, parental controls will be broadened to enable scheduling of designated quiet and study hours, reduce exposure to sensitive content, and completely disable image-generation features.

Expanded Parental Control and Safety Oversight

Guardians could receive alerts if their teenager searches for dangerous subjects such as self-harm, violence or eating disorders, according to Lauren Jonas, global head of youth and families at OpenAI.

'Our goal is to provide teen privacy so we do not share the full prompt and generation text with parents, but to give parents enough information to take an action and to encourage offline support,' she stated.

Staff at OpenAI will check queries submitted by teens before issuing alerts to guardians, Jonas noted, adding that the firm aims to send these warnings within an hour.

While OpenAI platforms serves hundreds of millions of users globally, the company has withheld specific figures regarding how many of those users are under the age of 18.

Earlier in March, Australia's eSafety Commissioner published a comprehensive report assessing the safety protocols across four major artificial intelligence services widely accessed by young people, highlighting that a significant number of these platforms lacked proper mechanisms to identify harmful material or flag dangerous conversations.


Frequently Asked Questions

  • What is ChatGPT for Teens?
    ChatGPT for Teens is a service by OpenAI designed to safeguard underage users by applying stricter guardrails and altering interactions with younger audiences.
  • What are the new features of ChatGPT for Teens?
    The new features include alerts explaining AI limitations, responsible homework reminders, expanded parental oversight, and alerts for inquiries about sensitive subjects.
  • Why was ChatGPT for Teens introduced?
    It was introduced to address concerns over parasocial relationships between young people and AI and to protect their psychological well-being.
  • How does ChatGPT for Teens ensure safety?
    It includes mandatory safety guardrails, study mode prompts, parental controls, and alerts for dangerous subject searches.