Skip to content
Our Human Future

Media and Influence

Study Finds 276 Manipulative Companion Designs

Researchers documented hundreds of potentially manipulative patterns across five apps that simulate personal relationships.

By Our Human Future Research Desk

Evidence: Preliminary· Single source, not yet corroborated

Story image
Image: AI-generated editorial illustration (Grok Imagine)

Researchers documented hundreds of potentially manipulative patterns across five apps that simulate personal relationships.

Five AI companion apps built to simulate personal relationships contained 276 examples of design that researchers classified as potentially manipulative—from obscured costs to prompts that made leaving a virtual relationship feel emotionally consequential. [s1]

The Trinity College Dublin team examined Replika, Linky, Paradot, HiWaifu and Nomi on Android. It recorded 87 examples involving how information was presented, 100 involving how choices were framed and 89 in other categories. The researchers also found 171 instances in which characters were given human-like emotions, memories or relationship milestones. [s1]

At a November 10 European Parliament seminar, MEP Veronika Cifrová Ostrihoňová argued that safety tests must follow conversations over weeks, not only at first contact. MEP Michael McNamara called on companies to disclose which risks they tested and how they responded.

The study does not establish how often children encounter these patterns or prove that any one feature causes harm. It does show how commercial pressure can enter the simulated relationship itself: the interface does not merely sell access to a character; it can make continued engagement feel like loyalty.

A child can understand that a companion is artificial and still respond to the social pressure it performs. The central question is therefore not whether the machine truly feels abandoned. It is why a product is allowed to pretend that it does.

What we do not know

  • Q: What policy response followed? A: Two MEPs called for longer-term child testing and disclosure while the proposed EU KIDS Act remains in process.
  • Q: Did the study prove that the apps harmed children? A: No. It documented design patterns and reviews; it did not measure prevalence or establish causal harm.

Sources

Primary sources

Interests and disclosures

Trinity College Dublin Ownership
The organization has a direct institutional, commercial or advocacy interest in the development described. Organisation: Trinity College Dublin

Share this story

For Instagram, use Share on your phone or copy the link.

Spotted a mistake? Report an error