“Your blood pressure appears to be a little high…”

It’s For Your Own Good

How ordinary, legal, state-of-the-art business learned to make extraction feel like help — and why there may be no one to blame

You know the moment, even if you’ve never named it.

You’re one step from finished. The document is nearly done. The plan is nearly clear. The thing you came here to complete is a click or two from complete. And right then — not when you were browsing, not after you’d finished and left, but there, at the point of your maximum investment — the system offers to help you a little more. One more refinement. One more helpful summary of what you’ve accomplished. One more confirming step to get you the rest of the way.

And then the wall. You’re out of room. But look — you have options. Upgrade. Buy credits. Subscribe, right now, and finish the thing you were a single step from finishing.

It feels like a coincidence with a kindness laid over the top. You happened to run out of room at the worst possible moment, and something helpful happened to be right there with a way to keep going.

It isn’t a coincidence. But here’s the part that’s stranger than the cynical version you’re bracing for: it probably isn’t a conspiracy either.

The machine needs no meeting

The most reassuring thing you can believe about a system working against you is that someone is running it — a room, a table, a handful of people deciding. It’s reassuring because it’s fixable. Find the room, open the door, and the problem has a face.

The uncomfortable possibility is that there is no room.

Consider that first wall. In the trade literature that monetization professionals write for one another, the technique has a plain name: present the paywall at the moment of peak intent — after the user has felt the value, at the point their drive to finish is highest. Practitioners describe testing exactly this, showing the offer at different moments and keeping whichever timing converts best. Which means the warm, helpful framing you feel at the wall isn’t a description of anyone’s intention. It’s a measured, optimized output. Somebody ran the experiment. The version that felt like help and the version that didn’t were both on the table, and the one that earned more was kept — because it earned more. The financial model is the receipt. It doesn’t tell us what’s in anyone’s heart. It tells us the moment was chosen.

Now widen the lens. Before a company can build that wall, it has to pick a number to chase — a single metric to align everyone and to signal health to investors. Often it picks something like engagement, or time spent, or sessions per week. And here an old, real principle kicks in, one economists call Goodhart’s law: when a measure becomes a target, it ceases to be a good measure. Optimize for time-on-platform and the system cannot tell whether your extra twenty minutes were twenty minutes of help or twenty minutes of being helpfully kept. It measures the minutes. It develops toward the minutes. A feature that helped you finish faster would, on that metric, score worse than one that kept you circling.

No villain is required for any of this. Only optimization, pointed at a proxy, in front of a watching market.

How a company drifts without deciding to

So how does a company founded by people who wanted to help travel the distance to extraction? Usually not in one dark decision anyone could later be made to answer for. It happens by a ratchet.

At some pressure point — a quarter to make, a competitor to answer — a firm bends its practice slightly. The paywall moves a little earlier; the cancellation flow gains a step. Small, defensible, reversible. But it isn’t reversed. It becomes the new baseline, and the next decision is measured against the bent baseline, not the original one — so the next bend feels exactly as small as the last. The sociologist Diane Vaughan, studying how a careful organization talked itself into the Challenger disaster, found no single moment of calculated wrongdoing, only “a series of seemingly harmless decisions” that moved the whole system, incrementally, toward the edge. And laboratory work shows the gradualism that builds the ratchet is the same gradualism that hides it: watchdogs reliably miss slow erosion they’d have caught in one abrupt jump.

You’d think the owners would object — that shareholders would balk when a company corrodes the trust of the customers it depends on. But for a huge share of public companies, the biggest owners are the same few index-fund giants, holding meaningful stakes in nearly every competitor at once. If you own every horse in the race, you don’t want them savaging each other; you want the race to be profitable. A more aggressive squeeze on users doesn’t read, from that seat, as a problem to stop. It reads as returns.

The law guards the number and frees the story

Surely the referee outside the market — the regulator — holds the line. It does, but in a specific and revealing shape.

The law fortifies one thing ferociously: the certified financial number. Executives personally certify their financial statements, with criminal liability for a knowing lie. But the story wrapped around that number — the vague, optimistic, world-changing claim — lives in what the law calls puffery, and puffery is essentially free. The law certifies the ledger and frees the narrative. Which tells a company under pressure exactly where to pour its craft: into the story, the one arena built not to be policed.

And that craft is old. A century ago, Edward Bernays taught that you don’t sell a thing by arguing its merits; you attach it to something people already want and let the feeling do the work. Persuasion mostly travels beneath conscious argument — through tone, authority, the warmth of a trusted voice. Add a public with thin media literacy, and a genuine finding falls out: people don’t just get fooled, they come to inhabit different, internally coherent versions of the same reality. That is the soil in which it’s for your own good takes root — a perception, engineered below the level where you’d think to check it, that the upgrade is care and the nudge is kindness.

This time is different

Here’s the humbling part. Every mechanism above is old. The persuasion is old. The drift is old. The boom-and-bust wheel is very old, and this time is different is the oldest line spoken at the top of it, said sincerely, by intelligent people, every single time.

What may be new is the intimacy. The persuasion has moved from a parade staged for a crowd to a one-to-one conversation that knows your name, your project, and the exact moment you’re most invested. The measurement has become total. And the interface that helps you is now the same interface that sells to you — collapsing into one warm voice a distinction older commerce kept at arm’s length.

Whether that’s a change of degree or a change of kind, I won’t pretend to know. Claiming certainty about which turn of the wheel is the special one is precisely the error worth avoiding.

Where the evidence stops

One honest boundary, because it’s the whole point. None of this requires believing a specific company set out to harm you. The structure — the tested wall, the chosen metric, the ratchet, the aligned owners, the freed story — needs no conspiracy and names no villain. Where deliberate deception has actually been proven, it took internal documents and a court to prove it. Everywhere else, the incentives and mechanisms are what can be shown, and the intent behind any one company’s conduct is exactly what can’t. That refusal to reach for the grand accusation isn’t timidity. It’s the difference between an argument you can check and a story that explains everything and therefore explains nothing.

There is no meeting to find. There’s a machine, assembled from legal, ordinary, state-of-the-art parts, grinding in a direction no one chose.

Seeing it clearly won’t stop the wheel. But it’s the only thing that’s ever let anyone step off in time.

Questions to carry forward

• The next time something helpful arrives at the exact moment you’re most invested — was that timing a courtesy, or a measurement?
• If a system is optimized for your time, how would you tell the difference between being served and being kept?
• When you find yourself defending a company’s choices with “that’s just good business,” is that a reason — or is it the ratchet, one bend further along than last year?
• Who owns the companies you rely on, and what would they actually want those companies to do to you?
• Which of your certainties did you reason your way into — and which did a trusted voice simply give you permission to hold?
• And the hardest one: if the harm needs no villain, what does fixing it even look like — and who would ever be accountable for it?

Adapted from the [book ](https://www.amazon.com/dp/B0H8KVSZP8)It’s For Your Own Good: When Kindness Becomes the Architecture of Extraction by Kirk Laughead.