We Stopped Expecting Accountability and Started Hoping for Self-Control.

Those Are Not the Same Thing.

The most powerful companies of our era keep saying, in one form or another, that someone should really slow them down.

Matt Levine noted why that might be shrewder than it sounds. Slowing down could actually serve the labs: less spent on ruinously expensive compute, and a longer runway to charge frontier prices. But agreeing to it together would be an antitrust conspiracy, so publishing urgent safety papers and letting the government act on them would get them coordination they can’t legally arrange themselves. Sincere concern and self-interest, pointing the same way.

I’ve said I can’t tell you which motive is real, and neither can anyone else, because a sincere paper and a strategic one look identical on the page. But sit with what the request actually is. “Someone should stop us” is a powerful party announcing it will not stop itself, and handing the responsibility to whoever will take it. It is an admission that self-control is not coming. And that should have been obvious, because self-control was never the thing that governs anyone, least of all the powerful tech bro class.

Here is the shift I think we’ve sleepwalked into, and it worries me more than any single company’s incentives. We have quietly replaced accountability with self-control as the expectation, and started treating them as if they’re the same. They are not even close.

Self-control is the actor policing itself. It is a hope. It works right up until restraint becomes expensive, and then it evaporates, because it was never a control in the first place.

Accountability is something else entirely. It is consequences, imposed by someone who has the authority to impose them and no stake in the outcome. One is a New Year’s resolution. The other is an audit. We have spent the last few years asking the most powerful actors in the economy to make resolutions, and calling it governance.

I know what real oversight requires because I do a small version of it. I sit on a public board that oversees a budget north of $70 million. Nobody on that board governs by walking up to the people spending the money and saying “please be responsible.” That would be absurd, and everyone would rightly lose their minds. You govern by verifying. You separate the person proposing from the person checking. You require disclosure. You do the unglamorous homework to understand the numbers well enough to ask the question that actually bites. The entire apparatus exists for one reason: because self-control has never once been a reliable control, and pretending otherwise is how money and power go missing.

Which brings me to the part I’ll say plainly. Being the adult in the room is not a posture. It is not a stern soundbite at a hearing, or a viral clip of someone scolding a CEO, or a bill announced in a press release and never understood by the person announcing it. Being the adult means doing the work: understanding the compute economics, the incentives, the actual mechanics of what can and can’t be verified, well enough to build oversight that means something. And too often the people who hold the authority to govern this are not engaging at that level. They are legislating vibes, or not legislating at all, and mistaking the performance of concern for the exercise of it.

I want to be fair, because fairness is the point. This is genuinely hard. The technology moves faster than any legislative process was built to handle, most of these bodies are under-resourced and out of their depth, and some serious people are trying honestly. Difficulty is real. But difficulty is the job. If you take the seat that comes with the authority to hold power accountable, you owe the homework that makes accountability possible. Showing up unprepared to govern the most consequential technology of the century is not a neutral act. It is an abdication dressed up as deliberation.

And here is why the drift is so seductive: it lets everyone off the hook at once. The powerful get to look humble while keeping both hands on the wheel. The overseers get to look busy without learning the material. The rest of us get to feel like someone, somewhere, is handling it. Everybody is comfortable. Nobody is accountable. That is exactly the arrangement that produces disasters, in a boardroom or a country, the room full of people performing responsibility while the actual mechanism of it sits empty.

So no, I don’t think the interesting question is whether the labs mean it when they ask to be stopped. The interesting question is why we keep waiting for powerful people to control themselves instead of demanding the boring, rigorous, deeply human work of accountability. Self-control is what you hope for from people you can’t govern. Accountability is what you build when the stakes are too high to hope. We are very clearly in the second situation. We are mostly still doing the first.

The adult chair in this room is open. It has been open for a while. Someone who has actually done the reading should sit down in it.

For the people who work in oversight, audit, compliance, governance of any kind: where else are we quietly accepting “they’ll police themselves” as if it were a real control? I have a feeling once you start naming them, the list gets long fast.

Check out my Substack for more AI news and analysis.