𝗦𝗵𝗼𝘂𝗹𝗱 𝗝𝘂𝗻𝗶𝗼𝗿𝘀 𝗖𝗼𝗱𝗲 𝗪𝗶𝘁𝗵 𝗔𝗜?
We assume AI helps junior developers ramp up faster. Learn the codebase quicker, ship sooner, and close the skill gap with seniors.
Anthropic just ran a randomized controlled trial that challenges this. 52 developers learned a new Python library for async programming, half with AI assistance, half without. The AI group scored 𝟭𝟳% 𝗹𝗼𝘄𝗲𝗿 on comprehension tests. That's nearly two letter grades (50% vs 67%, p=0.01). The largest gap? 𝗗𝗲𝗯𝘂𝗴𝗴𝗶𝗻𝗴, the exact skill juniors need to catch errors in AI-generated code.
AI didn't even make them faster. The AI group finished about two minutes earlier, but this wasn't statistically significant. Some participants spent up to 30% of their time just writing prompts.
𝗛𝗼𝘄 𝘆𝗼𝘂 𝘂𝘀𝗲 𝗔𝗜 𝗱𝗲𝘁𝗲𝗿𝗺𝗶𝗻𝗲𝘀 𝘄𝗵𝗲𝘁𝗵𝗲𝗿 𝘆𝗼𝘂 𝗹𝗲𝗮𝗿𝗻 𝗮𝘁 𝗮𝗹𝗹
The study identified six interaction patterns. Three scored below 40%, three scored above 65%.
Low scorers:
→ Delegated everything to AI
→ Started manually, then progressively offloaded work
→ Used AI as a debugging crutch without building understanding
High scorers:
→ Generated code, then asked follow-up questions
→ Requested explanations alongside code
→ Asked conceptual questions, coded independently
Same tool, but different outcomes.
This implies that unrestricted AI access during onboarding creates a capability gap. We get faster task completion today, but we lose the debugging instincts needed to validate AI output tomorrow.
Think about it before you onboard new junior developers.
Image: Anthropic.