As candidates increasingly use AI to prepare for interviews, refine their applications, and in some cases even assist in real time during remote interviews, traditional hiring processes are struggling to actually assess what they were originally designed to assess. This is a specific and costly consequence of AI adoption showing up disproportionately on one side of the hiring table, the candidate side, without a corresponding adjustment on the employer side, and businesses that haven't adapted are spending more time interviewing while getting worse signal than before.
------------- Context -------------
Traditional interview processes were designed with a set of implicit assumptions about what a candidate's answers, on the spot, in real time, actually revealed about their genuine knowledge, judgment, and communication ability. AI has quietly undermined several of these assumptions.
Candidates can now use AI extensively to prepare polished answers to common interview questions in advance, and in some remote interview settings, there have been documented instances of candidates receiving real-time AI assistance during the interview itself, generating responses that the candidate then relays, without the interviewer necessarily being aware this is happening.
The result is a specific degradation in interview signal quality: the traditional interview format increasingly measures a candidate's ability to prepare with or use AI assistance well, rather than measuring the underlying knowledge, judgment, and communication skill the interview was originally designed to assess. Businesses that continue running interviews exactly as they did before AI became widely accessible are, in a meaningful number of cases, making hiring decisions based on signal that's considerably less reliable than it used to be, without necessarily realizing the reliability has degraded.
------------- Where This Degradation Becomes Visible -------------
A small company's hiring manager described discovering this gap directly after a series of hires that hadn't worked out as well as their strong interview performances had suggested. Digging into what had gone wrong, she began to suspect, based on some specific patterns in interview responses, that at least some of the candidates had been using AI assistance more extensively than the traditional interview format was designed to account for, whether through extensive advance preparation that produced unusually polished but somewhat generic answers, or through less certain but plausible real-time assistance during remote interviews.
The specific pattern that raised her suspicion was a mismatch between interview performance and actual on-the-job performance: candidates who had interviewed exceptionally well, with smooth, comprehensive answers to difficult questions, were in several cases underperforming relative to that interview signal once actually in the role, suggesting the interview itself had stopped reliably measuring what it was meant to measure.
Her company's response involved a specific redesign of their interview process: shifting toward more in-person or closely monitored interview formats for later stages, incorporating unscripted, adaptive follow-up questions that were harder to prepare for extensively in advance, and adding practical work-sample assessments that measured actual applied skill rather than relying primarily on verbal interview performance. This redesign took real time to implement, but it meaningfully improved the correlation between interview performance and actual subsequent job performance, addressing the specific gap that AI-assisted interview preparation had opened up in their previous process.
------------- Redesigning for Signal Rather Than Performance -------------
The broader lesson is that hiring processes built for a pre-AI environment need deliberate redesign attention, the same way any other business process does, to remain reliable in a landscape where candidates have access to significant AI assistance that the original process design never accounted for. This doesn't mean assuming bad faith on the part of every candidate, since much AI-assisted interview preparation is a completely reasonable use of available tools. It means recognizing that the traditional interview format's reliability as a signal has genuinely changed, and adjusting the process to account for that shift rather than continuing to rely on a process that no longer measures what it was designed to measure.
------------- Practical Moves -------------
First, honestly assess whether your current interview process has shown any signs of the specific mismatch pattern, strong interview performance not correlating well with actual subsequent job performance, that can indicate AI-assisted interview preparation or real-time assistance is affecting your hiring signal.
Second, incorporate more adaptive, unscripted follow-up questions into your interview process, which are harder to prepare for extensively in advance and tend to reveal genuine understanding more reliably than heavily rehearsed responses to predictable questions.
Third, consider adding practical work-sample assessments for roles where this is feasible, measuring actual applied skill directly rather than relying primarily on verbal interview performance as a proxy for capability.
Fourth, for remote interview processes specifically, consider what monitoring or format adjustments would help ensure the interview is genuinely measuring the candidate's own real-time thinking rather than relayed AI-generated responses, while remaining respectful and not assuming bad faith by default.
Fifth, periodically revisit your hiring process's actual predictive accuracy by tracking how well interview performance has correlated with subsequent job performance over time, and use that data to continue refining your approach as candidate use of AI assistance continues to evolve.
------------- Reflection -------------
AI-assisted interview preparation and, in some cases, real-time assistance during interviews themselves have genuinely changed what traditional interview processes are actually measuring, and businesses that haven't adjusted their hiring process accordingly risk making decisions based on signal that's considerably less reliable than it used to be, without necessarily realizing the shift has happened.
The businesses hiring most effectively right now aren't necessarily running longer or more extensive interview processes. They're the ones who've recognized that their process needs the same kind of deliberate redesign attention that any other business process requires when the environment around it has fundamentally changed, and who've adjusted specifically to restore the reliability of the signal they're actually trying to gather.
Has your hiring process been adjusted at all to account for how candidates now use AI in preparing for and potentially during interviews, or is it still running exactly as it did before this shift became widespread?