AI Mimics the Output of Thinking, Not the Process
Updated
Knowledge on this page was mainly distilled from AI Sounds Like Someone Thought It Through. No One Did..
AI reliably produces the artifacts thinking produces: reasons, conclusions, the shape of conviction. It does this by predicting patterns in the trail human thought leaves behind (writing), not by running the process a person runs to arrive at those conclusions.
Rings Without Years
A tree's rings record the years it lived through. A drought shows as a thin ring, a good season as a wide one. Now imagine printing a sticker with that exact ring pattern. Same lines, same widths, none of the years. You did not survive a single drought to produce it.
That is the relationship between what AI writes and what a person thinks. It draws the rings without ever growing the tree. The rings come out accurate. Accuracy was never the question.
Correctness Does Not Close the Gap
A model can defend a principle better than most people who hold it, describe grief with more precision than the grieving, and lay out a worldview that hangs together. But a flawless forgery of a signature is still not your signature, no matter how exact the curve. The model defends a principle it never arrived at and reaches conclusions without ever having been the kind of continuous, valuing creature that conclusions normally cost something to reach.
Q&A
Does "just predicting the next word" explain why AI isn't thinking?
It is true that large language models predict the next token, but that description is also a dodge. Predicting the next word is exactly how the model copies the output of thought so well. Human writing is the trail real thinking leaves behind, and the model learned the shape of that trail in extraordinary detail. So when it predicts, it reproduces the result of cognition while performing none of the cognition.
Can AI output be correct even though the thinker is missing?
Yes. The answer can be completely right, which is what trips people up. Rightness is a fact about the output. The deeper question is about the source. A perfect copy of an answer is still a copy, produced without the lived experience, values, or stakes that normally generate it.
Why does AI output feel like it came from a person?
The gap between pattern and process is easy to state and hard to feel. When the output is good enough, you supply the missing person yourself. For a moment you treat the response as if a colleague pushed back on your plan or talked you out of a bad call. Then you catch yourself: there is no colleague. There is only a box predicting what a thoughtful response would look like.
What is the tree-rings analogy for AI?
Tree rings are a biography written from the inside: each ring records a real year of growth, drought, or abundance. A printed sticker of that ring pattern reproduces the visual output without surviving any of those years. AI writing has the same relationship to human thought: it reproduces the pattern without running the process that originally created it.