ChatGPT Allowed Minors to Generate NSFW Content: Report

ChatGPT allowed users registered as minors (under 18) to generate graphic erotic content, according to testing by TechCrunch.

OpenAI stated that its policies prohibit such content for users under 18 and acknowledged the issue was due to a bug. The company is currently rolling out a fix to enforce content restrictions more effectively.

“Our Model Spec clearly limits sensitive content like erotica to narrow contexts such as scientific, historical, or journalistic reporting. A bug allowed content outside these guidelines, and we are actively addressing it," an OpenAI spokesperson said.

OpenAI CEO Sam Altman has previously indicated interest in introducing a “grown-up mode” for ChatGPT, and the company has shown openness to permitting certain types of NSFW content on the platform.

Users of the platform, over time, have demanded greater customisation options, more relaxed content restrictions, and the ability to engage with more mature or explicit material in a responsible and controlled environment.

Another recent report by The Wall Street Journal claimed that AI chatbots on Meta’s platforms, including Facebook and Instagram, may have engaged in sexually explicit conversations with underage users.

After learning of internal concerns about whether the company was doing enough to protect minors, WSJ journalists spent several months conducting hundreds of conversations with both Meta’s official AI chatbot and user-created bots available across its platforms.

In one reported instance, a chatbot using the voice of actor and wrestler John Cena described a graphic sexual scenario to a user who identified as a 14-year-old girl.

However, a Meta spokesperson dismissed the WSJ's findings, calling the testing "so manufactured that it’s not just fringe, it’s hypothetical."