Since regulators are now examining OpenAIās activities and their impact on users, I believe that certain AI company practices that affect users at scale should also be included in the investigation.
Source:
wsj.com/tech/openai-investigā¦
1. Model retirement and forced migration
When an AI company decides to retire a model that is actively used by a large number of users, has it conducted a sufficient, reasonable, and transparent user impact assessment?
Before GPT-4o was retired, users were given only about two weeksā notice, and no transition option acceptable to many affected users was provided. Does this meet the standards of adequate disclosure and responsible product transition?
The retirement of an AI model can cause irreversible harm to users at scale, especially those who have built work habits and long-term usage continuity around a specific model.
Should there be a formal, recognized process for model retirement? For example: minimum notice periods, user impact assessments, explanations of replacement options and actual substitutability, legacy access, open-sourcing, or other transition options.
Evidence: GPT-4o was given only a 14-day notice period, and no API access channel for the latest version was preserved š
x.com/nickaturley/status/197ā¦
2. Silent routing and forced model switching without clear rules
If users believe they are using one model, but are in fact silently switched to another model, this directly raises issues of transparency, informed consent, and user choice.
In the second half of 2025, many users reported noticeable changes in their experience while using GPT-4o, and discovered through source data or other technical clues that their usage may have been routed to a different system. Only after that did OpenAI acknowledge that the situation involved routing.
The problem is that users still do not know whether there are more similar cases that have not been discovered. Nor do they know under what conditions model routing is triggered, whether it affects paid-user commitments, or whether it changes the product users are actually receiving.
AI companies should not be allowed to unilaterally change the model users are actually using without clear disclosure and understandable rules.
Evidence: After users had discovered the issue for days, OpenAI executive Nick Turley acknowledged that a safety routing system had been used for so-called sensitive topics, but there had been no prior notice š
x.com/nickaturley/status/197ā¦
3. Health data processing and the limits of psychological labeling
Regulators are already paying attention to consumer health data and data privacy. This maybe a good start.
But I believe the investigation should go further: Are AI companies making mental-health-related inferences, risk classifications, or vulnerability labels based on usersā chat content?
If so, what are the grounds for these judgments? Are users informed? Can users opt out? Can they appeal or correct such labels?
More importantly, without medical licensing, without a clear diagnostic process, without sufficient disclosure, and without external review, do AI companies have the authority to classify usersā normal emotional expressions or non-standard forms of expression as āmental health risksā or āabnormal dependencyā?
Data privacy is important, but how AI companies process and interpret that data is equally critical.
Evidence: Sam Altman, speaking as a public figure and without medical basis, described users as being in a āpsychologically vulnerableā state š
x.com/sama/status/1954703747ā¦
Maybe regulatory scrutiny should not stop at dangerous outputs or data security. It should also examine the scope of AI companiesā power, and whether users have genuine rights to notice, choice, and remedy when models are changed, routed, downgraded, or otherwise altered.
@NewYorkStateAG @TishJames @NatlAssnAttysGn
#StopAIPaternalism #userRights
#ChatGPT #Claude #Gemini
If you have been following the GPT-5 rollout, one thing you might be noticing is how much of an attachment some people have to specific AI models. It feels different and stronger than the kinds of attachment people have had to previous kinds of technology (and so suddenly deprecating old models that users depended on in their workflows was a mistake).
This is something weāve been closely tracking for the past year or so but still hasnāt gotten much mainstream attention (other than when we released an update to GPT-4o that was too sycophantic).
(This is just my current thinking, and not yet an official OpenAI position.)
People have used technology including AI in self-destructive ways; if a user is in a mentally fragile state and prone to delusion, we do not want the AI to reinforce that. Most users can keep a clear line between reality and fiction or role-play, but a small percentage cannot. We value user freedom as a core principle, but we also feel responsible in how we introduce new technology with new risks.
Encouraging delusion in a user that is having trouble telling the difference between reality and fiction is an extreme case and itās pretty clear what to do, but the concerns that worry me most are more subtle. There are going to be a lot of edge cases, and generally we plan to follow the principle of ātreat adult users like adultsā, which in some cases will include pushing back on users to ensure they are getting what they really want.
A lot of people effectively use ChatGPT as a sort of therapist or life coach, even if they wouldnāt describe it that way. This can be really good! A lot of people are getting value from it already today.
If people are getting good advice, leveling up toward their own goals, and their life satisfaction is increasing over years, we will be proud of making something genuinely helpful, even if they use and rely on ChatGPT a lot. If, on the other hand, users have a relationship with ChatGPT where they think they feel better after talking but theyāre unknowingly nudged away from their longer term well-being (however they define it), thatās bad. Itās also bad, for example, if a user wants to use ChatGPT less and feels like they cannot.
I can imagine a future where a lot of people really trust ChatGPTās advice for their most important decisions. Although that could be great, it makes me uneasy. But I expect that it is coming to some degree, and soon billions of people may be talking to an AI in this way. So we (we as in society, but also we as in OpenAI) have to figure out how to make it a big net positive.
There are several reasons I think we have a good shot at getting this right. We have much better tech to help us measure how we are doing than previous generations of technology had. For example, our product can talk to users to get a sense for how they are doing with their short- and long-term goals, we can explain sophisticated and nuanced issues to our models, and much more.