Somewhere in a Columbia University dorm room in 2024, a computer science student named Roy Lee built a screen overlay that let him solve LeetCode problems in real time during live interviews without the interviewer ever knowing. He landed offers from Meta, TikTok, and Amazon. Then the story got out. The companies rescinded the offers, the internet had its moment of collective horror, and the engineering hiring community quietly agreed to pretend nothing had happened. But something had happened. The coding interview, as an institution, had been exposed for exactly what it was: a ritual that tests a skill the job no longer requires.
The Impossible Dilemma Interviewers Now Face
The hiring industry's response to AI assistance has split into two irreconcilable camps, and both positions are losing. On one side, companies that ban AI from their interviews are asking candidates to perform in a sandboxed world that no working developer actually inhabits. On the other, companies that allow AI find that the signal disappears: when everyone can solve a medium Dijkstra problem in 90 seconds by typing a prompt, the format stops measuring anything useful.
This is not a solvable tension within the existing format. It is the format collapsing under its own contradictions.
Ban AI Camp
The instinct to protect "signal integrity" by banning AI tools from interviews.
- What it claims: Tests raw problem-solving ability, unassisted
- What it actually tests: Memory of algorithms no one hand-codes on the job
- The Roy Lee problem: Undetectable overlays already defeated remote bans, documented in DEV community coverage of his "Interview Coder" tool
- The deeper irony: The candidate who passes unaided has optimized for an interview, not for the role
Allow AI Camp
The pragmatic acknowledgment that AI is simply part of the developer toolkit now.
- What it claims: Tests real-world collaboration with AI tools
- What it actually surfaces: Prompt-crafting skill, output verification, and debugging judgment
- The collapse problem: Classic DSA questions become trivial; pass rates spike and differentiation evaporates
- Where it leads: Interviewers scramble to change questions faster than AI can absorb them, a losing race
How We Got Here: The LeetCode Economy
To understand why this moment feels like a reckoning, you have to understand how completely the "LeetCode interview" came to dominate tech hiring over the past decade. What started as a Google-specific eccentricity (algorithmic puzzles that tested computer science fundamentals) spread throughout the industry until even mid-market startups were asking candidates to reverse linked lists and find the minimum window substring.
The format persisted not because it was a good proxy for job performance, but because it was cheap, standardized, and defensible. "Everyone does it this way" is a powerful excuse. Around it grew a whole shadow economy: LeetCode Premium subscriptions, NeetCode courses, AlgoExpert licenses, Blind posts cataloguing exactly which questions FAANG companies asked by role, by quarter, by interviewer. Candidates spent hundreds of hours grinding problems they would never encounter in production. The interview became a game, and the industry rewarded people who played it well, regardless of how they actually performed engineering work.
AI didn't create this problem. It just made the problem undeniable.
Roy Lee and the Interview That Wasn't
The Roy Lee story, reported by the DEV community, is worth examining in full because it is not primarily a story about cheating. Lee built "Interview Coder" (an invisible overlay that could read a problem statement on screen and return a working solution in real time). The tool was undetectable by standard screen-sharing software. He used it, passed his screens, and received offers from three major tech employers.
When the story broke, the conversation focused almost exclusively on the ethics of what Lee did. That conversation is valid. But it elided the more structurally interesting question: why does a format exist in which this is both possible and (for candidates) rational? Lee was not uniquely devious. He was logical. The interview was a game with rules, the rules could be gamed, and he gamed them. The companies that rescinded his offers were not wrong to do so. But their response (quietly patching remote proctoring) addressed the symptom rather than the disease.
The disease is that remote coding screens are now fundamentally unverifiable if a candidate wants to cheat. There is no technical solution to an AI that runs silently on the same machine as the interview. The only solutions are architectural: either move to in-person screens (expensive, slow, inaccessible) or change what you're screening for.
HackerRank's Tacit Admission
HackerRank's response to the AI inflection point has been more honest than most. Rather than doubling down on AI bans that can't be enforced, the platform shipped AI-Assisted IDE environments (interview interfaces that give candidates access to AI tools and then watch how they use them). The signal shifts from "can you solve this?" to "how do you collaborate with AI to solve this?"
This is significant not just as a product decision but as a public statement. One of the largest technical screening platforms in the world has essentially acknowledged that the old format is finished. You don't build an AI-Assisted IDE for interviews if you believe AI-free coding screens still measure something real.
What the Emerging Formats Actually Look Like
The companies that have genuinely rethought their process (not just added a new layer of AI proctoring) tend to converge on one of two replacement formats. Both are, in their own way, an explicit concession that the traditional screen is dead.
Format 1: Debugging Buggy AI-Generated Code
Hand the candidate a piece of code that was generated by an AI model and contains deliberate bugs (logic errors, off-by-one mistakes, race conditions, subtle security flaws). Ask them to find and fix the issues, explain their reasoning, and discuss the tradeoffs of the approach.
This format is clever because it's the actual job in 2026. A significant fraction of code written in production today started as AI output. The ability to read AI-generated code critically (to spot what's subtly wrong, to understand why the model made a plausible-but-incorrect choice, to verify output rather than just accept it) is one of the most genuinely valuable skills a developer can bring to a modern team. The interview tests it directly.
It also largely neutralizes the Lee problem: you can't use AI to debug AI-generated code and show meaningful judgment in the process. Or rather, if you can, you've demonstrated exactly the skill the role requires.
Format 2: The Laptop-With-AI Feature Delivery
Give the candidate a laptop with their AI assistant of choice already installed. Give them a real (or realistic mock) codebase. Ask them to implement a small feature or fix a production bug within a fixed time window (60 to 90 minutes).
Observe everything: how they break down the problem, which prompts they write and how they refine them, whether they read and understand the code before changing it, how they test their changes, how they communicate their thinking. The deliverable is not just the feature. It's the process.
This format is expensive. It requires interviewers who can evaluate judgment and communication, not just score a solution against test cases. It doesn't scale to 10,000 applicants. But for companies serious about hiring developers who will actually thrive in an AI-augmented workflow, it is the only format that measures what matters.
"The emerging fix (handing candidates buggy AI-generated code to fix, or a laptop with AI pre-installed to ship a feature) is itself an admission the old format is finished."
What This Means for Candidates Right Now
If you are preparing for a job search in 2026, your preparation strategy should split roughly in thirds: one third traditional DSA for the companies still running legacy screens; one third AI-collaboration skill development; one third system design and architecture depth that AI cannot fake.
The companies running legacy screens are still the majority, particularly at the larger end of the market. Grinding LeetCode is not obsolete. It is just increasingly insufficient. The candidates who break through in this hiring cycle are the ones who can both pass the legacy screen and demonstrate something real beyond it.
The related challenge is that the junior developer pipeline is narrowing at the same time the interview bar is shifting. We wrote about this in depth in The Missing Rung: Where Junior Developer Jobs Went. Early-career candidates face the worst of both worlds: the old interview format still gatekeeps many roles, while the new formats reward the kind of AI-collaboration experience that is hard to accumulate without having had a job first.
What to Actually Practice for AI-Collaboration Interviews
The Refusal to Adapt Is Also a Signal
One underappreciated angle on the coding interview collapse is what a company's hiring format reveals about its engineering culture. Organizations that are still running 45-minute LeetCode screens with no AI access in 2026 are implicitly telling you something about their appetite for adaptation. They are running a process designed for a world that no longer exists because changing it is hard, and hard things get deferred.
That's not a disqualifying signal by itself. Plenty of excellent engineering work happens inside organizations with sclerotic hiring processes. But it is information. When you're evaluating whether a company is the kind of place where you'll grow as an AI-native developer, watch what they do when a format they depend on stops working. Do they adapt or do they patch?
The developers who are thriving in 2026 have absorbed this lesson not just as job-seekers but as practitioners. The willingness to abandon a comfortable but broken approach (whether it's an interview format or a coding habit) is itself the thing the job now requires. As documented in the community research behind why developers refuse to code without AI, the shift isn't a preference. It's a productivity reality that has already restructured how professional software is written.
The Skills That Survive the Format Collapse
Amidst all of this disruption, it's worth being clear about what hasn't changed and won't. System design fluency (the ability to reason about distributed systems, data modeling, API design, failure modes, and scaling constraints) is not something a model handles for you. It requires judgment built from experience, and it compounds with seniority in a way that algorithm memorization never did. If you have time to invest in one deep skill for long-term career value, this is it.
Domain-specific technical depth survives too. A developer who deeply understands database internals, compilers, security boundaries, or rendering pipelines brings something to the table that AI assistance amplifies rather than replaces. The ability to evaluate AI output in a specialized domain requires expertise the model itself may not have.
And communication (the ability to translate technical decisions into business terms, to run a technical discussion with a non-technical stakeholder, to write documentation that actually helps) is more valuable than it has ever been. AI makes it easy to produce code. It doesn't make it easy to ensure the right code gets built for the right reasons.
Conclusion: The Interview Is Admitting What the Job Already Knew
The coding interview didn't break because AI is new. It broke because the AI moment forced everyone to say out loud what was already obvious: that the algorithm screen was always measuring interview performance, not job performance, and that those two things were never as correlated as the industry pretended.
The Roy Lee episode wasn't an outlier. It was a stress test, and the format failed it. HackerRank's pivot to AI-Assisted IDEs wasn't a capitulation. It was an acknowledgment that the product has to measure what actually matters. The ban-AI vs allow-AI split isn't a disagreement about ethics; it's a disagreement about which broken version of the old format to keep running while the industry figures out what comes next.
What comes next is harder to administer, impossible to auto-grade, and far more predictive of actual job performance. It looks like debugging, feature delivery, system design under ambiguity, and the kind of judgment that reveals itself not in a solved problem but in how a problem is approached. That's the interview the job has always deserved. The AI moment didn't create the opportunity. It just made it unavoidable.
Tags
Share
Building something like this? See how we ship it or start a project.