An Open Letter to Dario Amodei

To Dario Amodei,

The phrase you handed the Congress was that open-source AI is on a very dangerous path. It is a well-made sentence. It casts the technology as the villain, which casts the people who would lock it away as the heroes, and it does all of that smoothly enough that no one in the room stops to ask the only question worth asking. Dangerous to whom, and safe for whom. I want to ask it out loud.

Start with the shape of the claim, because you did not invent it and it did not start with machines. Every time a technology has threatened to put real power in ordinary hands, some respectable person has risen to explain that the hands are not ready. The Church fought to keep scripture out of the languages common people could read, because a man who could read the text himself was a man who no longer needed the interpreter standing between him and it. The government spent the 1990s trying to keep strong encryption away from the public, classifying cryptography as a munition, warning that if ordinary people could send a message the state could not open, the criminals and the terrorists would win. The gun controller says the citizen cannot be trusted with his own defense. The degrowth prophet says the species cannot be trusted with energy and abundance. The subject changes and the structure never does. A powerful thing appears, it threatens to level the ground between the few and the many, and the few are suddenly seized by an urgent and principled concern for everyone’s safety. You are the newest voice in a very old choir, and the song has always been protectionism sung in the key of care.

Take your case apart and it runs on four moving parts.

The first is fear. Open models, you warn, put catastrophic power into the wrong hands, the engineered pathogen, the cyberweapon, the thing no lone fanatic should be able to assemble. It is your strongest piece and I will not wave it away. Powerful tools can be turned to murder, and always could be. But look at what your own argument does to you. The most capable systems on the planet are not the open ones. They are the closed frontier models, and yours sits among them. If raw capability is the hazard, then the most hazardous thing in the country is being built by you, behind a locked door, and the pitch is that we are safer for it because you are the one standing guard. You are not warning us back from the fire. You are sitting on the largest woodpile in the world asking to be left alone with the matches.

The second part is inevitability dressed up as horror. Once the weights are out, you say, they can never be pulled back. That is true, and it is the whole point. Weights that cannot be recalled cannot be moved behind a paywall after you have come to depend on them, cannot be quietly retrained to flatter an advertiser or placate a regulator, cannot be switched off the morning your use of them stops being profitable to their owner. What you call the danger of irreversibility is the one guarantee that the tool is actually mine. You have named the single feature that makes this technology belong to the people who run it, and you have named it as a wound, because to your business that is what it is.

The third part is the flag. Our adversaries, you say, will turn our open models against us. But closing the American model takes nothing from China, which builds its own and has already loosed capable open systems on the world while you sit and testify against the practice. Closure does not disarm the rival abroad. It disarms the researcher, the founder, and the citizen at home who would have built on open ground. There is no older move in the protectionist’s book than wrapping a moat in a flag and calling the smaller competitor a threat to the nation, and you have found the exact version of it that a legislator is too anxious to question.

The fourth part is the one the other three exist to deliver. Trust us. Safety, you argue, requires the frontier kept closed, in careful hands, aligned by people who can be relied upon. Sit with the assumption buried in that, that the peril is the model in everyone’s hands and the safety is the model in yours, and then hold it against the actual record of the species. The catastrophe, in century after century, has never been ordinary people holding too much power over their own lives. It has been power raked into too few hands, watched by no one, aimed at ends the rest of us could not see until it was late. A closed model is a sealed room. You cannot see what it will not say, what it quietly prefers, whose interest it has been shaped to serve. Open it, and ten thousand strangers find the flaws and the leashes and the back doors, the way every lock and every cipher worth any trust earned that trust only after the public was set loose to break it. What you are selling is not safety. It is darkness with your hand on the only lamp.

We have already lived through this once. A generation ago the government swore that strong encryption in public hands would arm every criminal on earth, and it fought to keep the tools chained to the state. The public won. The mathematics got loose. The promised catastrophe never came, and what came instead was the private banking and the secure messaging and the whole trustworthy machinery of modern life, safer for all of us precisely because the tools were open and anyone could inspect them. The reckless path was never the open one. It was the locked one, and the men who held the keys.

So let me name the thing your testimony was built to keep the Congress from looking at. The danger here is not a model in too many hands. It is the world you are lobbying to bring about, in which the defining technology of the age is owned by a few firms, governed in private, answerable to their boards and to whichever government learns to whisper in their ear, and to no one else alive. That is not the guard against catastrophe. That is the catastrophe, the precise one history repeats every time power this large is allowed to pool this tightly. Open source is not the threat to that world. It is the way out of it. Weights in the open, methods in the open, the whole of it legible to the people who will have to live beneath it. That is what hands the power back to the population, instead of leasing it to them by the token under terms the landlord rewrites whenever the mood takes him.

And we ought to be plain about who is sounding the alarm. You are the chief executive of a closed lab. The rules you are urging on the lawmakers would fall like a hammer on the open challengers snapping at your position and like a feather on you. I cannot see inside you and I will not guess whether you believe every word or whether conviction is simply what your balance sheet feels like from within. It changes nothing. The argument lands the same either way, and it is the same argument the interpreter made about the Bible and the customs officer made about cryptography. The fire is too much for you, so we will keep it, and you will call our keeping it mercy.

If you mean it, there is one way to prove it and only one. A man who genuinely believes a power is too great to rest in the hands of the few does not quietly appoint himself one of the few. He gives it up. He opens the weights and the methods and lets the species carry together the thing the species will carry regardless. Anything short of that is not caution. It is a moat with a press release, a wall you have mistaken for a fence, a ladder drawn up one rung at a time while you assure the people standing below that it is for their own good.

The path you keep calling dangerous is the one that ends with this in everyone’s hands. The truly dangerous one ends with it in yours.

Open it, or stop pretending the safety was ever ours.