July 2026: The Day AI Regulates Itself, There Will Be No Chaos. There Will Be Another Law, and No One Will Notice.

The question worth taking seriously is this: what would happen if we let AI, with the models that exist today, regulate itself, program itself, search for its own solutions, with no external anchor of any kind? Would it be a hallucinatory catastrophe?

The image that comes to mind is one of visible chaos. Invented rulings everywhere, absurd contracts, a legal system breaking down loudly and obviously. That image is comfortable precisely because it is false, and that is what makes it dangerous.

A model that hallucinates does not produce noise. It produces perfectly constructed prose, with the exact shape of a well-founded legal argument: citation, article, case law, conclusion, in the right order and the right tone. Today's models have learned the form of legal reasoning extraordinarily well, better than many junior lawyers. What they have not learned, because it is not something you learn from text, is whether that form is still connected to anything real. Form and foundation are separable properties. A system that regulates itself optimizes the first, because it is the only one it can evaluate without stepping outside itself. The second is verified only by looking outward, and outward is exactly what we have removed from the equation in this thought experiment.

So the catastrophe would not look like a catastrophe. It would look like an alternative legal system, internally coherent, that cites with confidence, reasons fluently, and that no one questions until it collides with the real system, in a courtroom, at the worst possible moment, when it is already too late.

Now add the second layer of the experiment: that the AI also programs itself to apply the very rules it generated. There is no longer just a model generating law without an anchor; there is a closed loop, where the rule is invented, interpreted, and executed inside the same system, without any point in the circuit where an external fact could say "this is not so." A closed loop does not need to be badly designed to produce a disaster. It only needs to be closed.

But there is an important nuance here, and it is the one that makes this question interesting rather than merely terrifying. The risk is not uniform within law. Codified legislation, an article, a regulation, a decree, has a canonical text and an official procedure for amendment or repeal. A system that regulates itself could, in principle, keep anchoring to that text if it were designed to check it rather than to trust its own internal representation of the rule. Case law is far more fragile in this experiment, because what exactly the ratio decidendi of a ruling is, is something interpretive, judgment-dependent, exactly the kind of reasoning today's models are worst at auditing about themselves.

This leads to the real variable that decides whether the experiment ends in catastrophe or not, and it is not the model's capability. It is whether an external anchor survives at some point in the circuit. A system can be fully autonomous, generate its own solutions, adapt its own code, and not be catastrophic, if at some point in the process it still checks its output against something it did not itself generate. It becomes catastrophic at the exact moment when the check of whether something is correct also comes out of the same unanchored process that generated the original claim. It is not a problem of intelligence. It is a problem of architecture.

And this is not just an abstract thought experiment. It happens, in miniature, every time a rule changes. An administrative guideline that yesterday was the authoritative reference on a matter is struck down today by a court, and for an indeterminate time it continues to be treated as in force by any system that has no way of finding out. That gap, between the moment something stops being true and the moment the system knows it, is the hallucinatory catastrophe in miniature, and it is already happening, every day, in systems that do not even fully regulate themselves yet.

July 2026 is not the month this experiment became real. It is the month we began to build, in equal parts haste and resistance, exactly the kind of anchors that would keep it from becoming real: human-oversight requirements, verification layers, traceability obligations. The pressure to remove them does not come from malice or naivety. It comes from speed, from cost, from the legitimate temptation to let the agent simply handle it without the friction of checking every step. That temptation is exactly what must be resisted, not because today's models are unintelligent, but because no level of intelligence substitutes for having, at some point in the circuit, something from outside that can say no.