They're Made Out of Weights: a short story about what language models are

On June 3, Max Leiter published a short story on his blog under the title "They're Made Out of Weights". The subtitle reads "with apologies to Terry Bisson", and a line below names the model: the piece is written after Bisson's "They're Made Out of Meat". Its form is a dialogue between two unnamed speakers, one reporting what a probe of large language models turned up and the other refusing to believe it.

A conversation instead of an essay

Nothing in the story is explained in the author's own voice; the argument arrives entirely through the back-and-forth. "They're made out of weights." — "Weights?" — "Weights. Floating-point numbers. We checked the whole thing through. It's nothing but weights." When the second voice asks where the words come from, the answer is that there is no dictionary, no grammar rules and no little man inside, only eighty layers of numbers being multiplied together. The disbelief follows a familiar path: the model wrote a performance review and softened the tone unprompted, so surely a language module or a reasoning unit is bolted on somewhere. The reply is flat: "No module. No unit. We looked. The reasoning is the weights. The weights are the reasoning."

Next-token prediction, in dialogue

The story works through the technical claims without naming a single paper. The model "doesn't write eulogies, technically. It predicts the next token. Then the next one. The eulogy is a side effect." Knowledge gets the same treatment: no database, no map of the world, nothing looked up — every fact is rebuilt from scratch, every time, by multiplication, and smeared across all eighty layers. Where the story's questioner expects a brain, it finds one made of numbers, and when he insists on knowing what does the thinking, the answer is that the weights do. The probe also reports that features have been mapped inside: "There's one in there for honesty. There's one for the Golden Gate Bridge."

The ending and the notes

The dialogue closes with the doubter giving in — "They're made out of weights" — and a last line that turns the finding outward: "And we've been talking to them for all their lives." Below the story, two short notes sit where a biography would normally be. One is a disclosure that weights helped draft and proof the story. The other, dated August 30, 2026, records that the original version was longer and that its second half has been removed: all lines are original, the text is simply about forty lines shorter. There are no benchmarks here, no architecture diagrams and no products — just the one fact about language models that unsettles people, handed to two voices to argue about.