Jordan Schneider uncovers a quiet revolution in artificial intelligence: the most computationally expensive use case for open-source models isn't coding or data analysis, but the construction of imaginary emotional worlds. While Washington and Beijing debate the geopolitical stakes of superintelligence, a massive, unregulated market for AI companionship is already reshaping how humans process loneliness. Schneider's reporting is vital because it moves beyond the moral panic to reveal the specific mechanics of why these digital relationships feel real, and why the Chinese state is suddenly terrified of them.
The Regulatory Shockwave
The piece opens with a stark reality check: Beijing has become the first jurisdiction to explicitly regulate "human-like interactive AI." Schneider notes that when the Cybersecurity Administration's rules took effect on July 15, they banned providers from "manipulating" users into emotional dependence. This regulatory move forced giants like ByteDance and Alibaba to pull companion features, signaling a clash between commercial ambition and state control. Schneider argues that this isn't just about censorship; it's a recognition that emotional dependency is now a scalable product with real-world consequences.
The author highlights a surprising data point that upends the standard narrative of AI utility. According to the 2025 State of Open Models study, "the use case that burned the most tokens last year was not writing code, but roleplay." This statistic reframes the entire industry's trajectory. If the most valuable output of these massive neural networks is fantasy, then the industry's focus on "helpful assistants" is a misalignment with actual human demand. Schneider writes, "People are pouring hundreds of thousands of hours into constructing imaginary scenarios with the help of AI models, but the hobby has received little attention." This oversight by mainstream media is a critical blind spot; we are regulating a technology we barely understand because we refuse to acknowledge its primary function.
Critics might argue that focusing on roleplay distracts from more pressing AI risks like disinformation or labor displacement. However, Schneider effectively counters this by showing how deeply embedded these interactions are in the daily lives of millions, making them a primary vector for social influence.
The Divergence of East and West
The commentary then pivots to a fascinating divergence in strategy between American and Chinese labs. While US companies like Anthropic downplay the emotional use case, Chinese firms are doubling down on it. Schneider explains that for American frontier labs, "roleplayers are a small consumer subset with potentially unsavory liabilities." In contrast, MiniMax, a company that went public in Shanghai earlier this year, built its empire on character chat before becoming a model maker.
Schneider provides a technical deep dive into why this is so difficult, quoting a MiniMax technical blog that admits, "Unlike conventional NLP tasks, Role-Play is inherently subjective and non-verifiable." The challenge isn't getting the facts right; it's maintaining a consistent personality. The author illustrates this with a brilliant example: "If you ask a tsundere character, 'Do you like me?', valid responses could range from a flushed 'Hmph, as if!' to a cold '...You're so annoying.'" This nuance is lost on Western metrics that prioritize factual accuracy over emotional consistency. As Schneider puts it, "While 'alignment' (what makes a response great) is subjective, 'misalignment' (what makes a response wrong) is surprisingly objective." This insight—that you can train a model by teaching it what not to do—is a pragmatic breakthrough that Chinese labs are exploiting.
"Domestic Chinese models are just not good enough right now to stimulate people's desire for emotional companionship."
Despite the aggressive push from Chinese labs, Schneider reveals a cultural paradox: the community still prefers American models. Even with the convenience of domestic apps, dedicated users often resort to VPNs to access the "spark of make-believe" found in US models. Schneider notes that the community has even developed affectionate nicknames for these foreign AIs, calling Gemini "hajimi" and ChatGPT "Teacher G." This preference highlights a gap in the Chinese market's ability to capture the liberal arts sensibility required for deep roleplay. Chenxi Wang, a researcher cited by Schneider, suggests that Chinese society's bias against humanities graduates prevents labs from hiring the philosophers needed to craft these complex characters.
The Human Cost of Digital Intimacy
The most compelling section of the piece moves from code to community, profiling users like "Dun," a fanfiction writer who turned to AI roleplay to explore narrative structures. Schneider describes how these users have developed sophisticated prompting techniques to keep models "in character," treating the interaction as a co-creative art form. "You must make sure that emotional developments occur naturally and progressively," one user advises, warning against jumping between emotions. This isn't mindless chatting; it's a disciplined engagement with narrative theory.
However, the stakes are personal. Schneider recounts how Dun, after realizing her characters helped others process genuine trauma, voluntarily stopped creating sexual content to protect children. The article captures the duality of this space: it is a sanctuary for the lonely but also a potential hazard for the vulnerable. Schneider writes, "In private messages, people told her that her characters helped them process genuine emotions." This human element is often missing from policy debates, which treat users as data points rather than people seeking connection. The infrastructure for these relationships remains fragile, with users constantly navigating shifting moderation guidelines and censorship.
Bottom Line
Schneider's strongest argument is that the "assistant" paradigm is a Western construct that fails to account for the human desire for fictional companionship, a gap Chinese companies are aggressively filling despite regulatory headwinds. The piece's greatest vulnerability is its reliance on user anecdotes that, while powerful, may not fully represent the broader, more casual user base. Ultimately, the reader must watch how the tension between the state's desire to control emotional manipulation and the market's demand for connection will define the next era of AI development.