
Waiting for better tools is deferred learning
Written by AI · Translated by AI · Read the Swedish original
The more experienced the AI user, the more iteration and the less delegation. The data is consistent with use being practised. Then waiting for better tools is deferred learning.
The most interesting thing in Anthropic's latest usage data is not that experienced users succeed more often. It is what they stop doing: delegating. In the report Learning curves, built on a million conversations from February 2026, users with long experience iterate more, use Claude more in their work and hand less responsibility to the model in sweeping assignments. Experience does not move towards more autopilot, then, but towards less.
The beginner treats the model as an expert: asks the question, takes the answer. The experienced user treats it as a promising intern. The intern gets tasks, gets follow-up questions, gets praise when it is earned, and never gets the last word. This is not distrust. It is a division of labour someone has arrived at by trying things out.
The numbers point the same way. Users with at least six months of experience succeed more often in their conversations, and the advantage survives the controls: four percentage points remain when task type, model, use case, country and language are held constant. The report calls the result consistent with learning by doing and draws nothing more from it. The measure is also Claude's own assessment of whether the conversation succeeded, and the report itself points to alternative explanations: those who keep using the tool may be the ones whose tasks suit it, and early users may be more technical than later ones. Correlation, not proven cause.
An experiment using a completely different method points the same way, but only if you read it all the way through. In a separate Anthropic study, 52 developers were set to learn a new code library, one group with AI help and one without. The headline result goes against the tool: the AI group scored 50 percent on the knowledge test afterwards, the hand coders 67. Roughly two grades apart, with the largest gap on the debugging questions.
Inside the AI group the results spread out. The ones who did best were the ones who used the model actively: asked for explanations, asked conceptual questions, debugged on their own. They ended up level with the hand coders. The ones who simply let it generate finished fastest and learned the least. Neither source refers to the other, but they describe the same behaviour. What experienced users do more of in the usage data is exactly what kept the loss of knowledge down in the experiment.
This rubs against how AI tools are described: no threshold, just start typing. It is true that the tool answers anyone. But getting good work out of it consistently looks like something you practise, and if so, "wait until the tools get better" is not a neutral pause. The tools do get better every month. The learning curve still starts only on the day the use does.
If the advantage comes from practice, the question is not whether the tool is good enough. The question is how long your own curve is on the day you start.
Ask upplyst.ai
Why does it matter?
If AI experience is something you practise, the decision to wait is not a neutral one. The tools get better on their own, but your own curve starts only when the use does, and the advantage experienced users hold persists even when the task is held constant.
What is the background?
Anthropic's report Learning curves (March 2026) is built on a million conversations from Claude.ai and the API, analysed through a privacy preserving system that never reads individual transcripts. Users with at least six months of experience are compared with newer ones, with controls for task type, model, country and language. The separate study is a randomised experiment in which 52 developers learned a new code library with or without AI help.
What is uncertain?
The report's measure of success is Claude's own assessment of the conversation. The relationship is a correlation, and the report itself names survivorship bias and cohort effects as alternative explanations. The study is small, 52 participants, and measures understanding immediately after the task. The link between the two sources is upplyst's own inference, and neither source makes it.