The AI Assessment Effect Candidates often tend to adjust their answers or behavior to match what they believe the “ideal candidate” profile looks like. A new study published earlier this month found that when candidates believe they’re being assessed by artificial intelligence, they emphasize analytical skills and downplay their intuitive and emotional skills. This so-called “AI assessment effect” stems from the widespread assumption that AI-based evaluations prioritize rational, data-driven attributes over human-centric abilities. Researchers warn that if job seekers tailor their behavior to what they think AI values, their true competencies and personalities may remain hidden, undermining the integrity of the recruitment process. In addition if most candidates assume AI favors analytical traits, the talent pipeline could become increasingly uniform, limiting diversity and reducing the variety of perspectives within organizations. The researchers recommend 1) Radical transparency: Don’t just disclose that AI is used in assessments—be explicit about what it evaluates. Clearly communicate that your AI values a range of traits, including creativity, emotional intelligence, and intuitive problem-solving. Share examples of successful candidates who excelled by showcasing these qualities. 2) Regular behavioral audits: Go beyond demographic bias checks. Look for patterns of behavioral adaptation: Are candidates’ responses becoming more homogeneous over time? Is there a noticeable shift toward analytical self-presentation at the expense of other valuable traits? 3) Hybrid assessment models: Combine AI and human judgment to ensure a more balanced and holistic evaluation of candidates. See research published in the June issue of the Proceedings of the National Academy of Arts and Sciences. https://lnkd.in/ebtD4HBd
Understanding the Impact of AI on Candidate Screening
Explore top LinkedIn content from expert professionals.
Summary
Understanding the impact of AI on candidate screening means examining how artificial intelligence shapes the way companies select and evaluate job applicants. AI-driven tools can streamline hiring, but they also introduce concerns about fairness, transparency, and whether technology truly captures a candidate’s full potential.
- Prioritize human checks: Always review AI-generated shortlists to catch strong candidates who may have been filtered out due to rigid algorithms or misunderstood qualifications.
- Communicate AI criteria: Clearly explain to candidates how AI assesses applications and what qualities are being evaluated, helping applicants present their true skills and reducing anxiety about the process.
- Balance tech and people: Combine automated screening with human judgment to ensure that both technical skills and unique personal qualities are recognized in the hiring process.
-
-
Imagine candidates taking assessments or interviews wearing AI-powered smart glasses that project LLM responses onto lenses only they can see, and/or provide audio responses only they can hear. Are you going to ask candidates to remove their eyewear before an interview? New research from Dunlop & Lievens introduces the FAIR framework - Forbid, Advise, Insulate, Reimagine - and it's one of the most practical models I've seen for thinking through how employers should respond to candidate AI use in hiring. Here's the uncomfortable part: the two defensive strategies - Forbid (detection, proctoring, warnings) and Insulate (controlled settings, face-to-face only) - are explicitly described as temporary. Not potentially temporary. Explicitly temporary. And they make the case convincingly. Agentic AI can now literally take assessments on behalf of candidates - interpreting screens, moving cursors, entering text. Digital proctoring was designed for a world where the cheating tool was a second browser tab, not an agent operating the computer/device itself. But the real insight isn't about technology arms races. It's about construct validity. When some candidates use AI and others don't, your assessment scores aren't measuring what you think they're measuring. You're now capturing an uncontrolled mix of the target skill AND the candidate's GenAI literacy - their ability to recognize use cases, interact effectively with AI, and adapt its output. That's a confound, not a feature. The researchers argue the sustainable path forward is "Advise" and "Reimagine" - equalizing AI access across all candidates and designing assessments where human-AI collaboration IS the thing being measured. Meta is already doing this. Their coding interviews now let candidates use GenAI tools in real time - from a pre-approved set. Think about what that means. Instead of trying to catch people using AI, you're deliberately observing HOW they use it. What questions they ask. How they evaluate and adapt the output. Whether they can push beyond what the AI generates on its own. That's not lowering the bar. That's measuring what actually matters for how work gets done now. If the future of work is human-AI collaboration, then the future of hiring has to assess it too. The question isn't whether your candidates are using AI. They are. The question is whether your assessment strategy is designed around that reality - or still pretending you can prevent it. Links in comments. H/T to my colleague Ellen Whiteside for bringing this research to my attention! 🙏🏻
-
I rejected a perfect candidate last year. Not me personally. My AI screening tool did. 𝐈 𝐝𝐢𝐝𝐧𝐭 𝐞𝐯𝐞𝐧 𝐤𝐧𝐨𝐰. 3 first-author papers on reinforcement learning. 200+ Google Scholar citations. Stanford-funded research. The kind of profile recruiters dream about. The AI scored them 34 out of 100. Why? Their CV said "statistical learning systems" instead of "machine learning." Thats it. One synonym. The tool couldnt make the connection. I only found out because I manually reviewed the reject pile on a hunch. 47 profiles deep into an 8-hour sourcing session. If I hadnt looked, my competitor would have placed them. (Most recruiters dont know their AI screening tools cant distinguish between technical synonyms — and theyre making decisions on hundreds of thousands of applications.) This isnt a one-off. Across 28 businesses, Ive documented the same pattern: AI systematically rejects candidates with non-linear careers, unconventional project descriptions, or terminology that doesnt match the job spec word-for-word. 19% of organisations using AI in hiring admit their tools screen out qualified people. SHRM published that number. The real number is higher. Most teams dont check. Heres what I changed: every AI-screened shortlist gets a human verification pass. Every one. I built a prompt engineering framework for JD analysis so the AI actually understands context before it scores. Time-to-screen dropped 60%. Not because the AI got better. Because a human catches what it misses. The EU AI Act classifies every CV screening tool as high-risk. August 2026. 115 days. Fines up to 35M euros. Most recruiting teams still cant explain what their AI tools actually do. Do you manually check your AI-screened shortlists, or do you trust the scores? Save this before your next screening audit.
-
Candidates should be genuinely concerned about how companies use AI-powered Applicant Tracking Systems (ATS) and sourcing tools. TA Tech companies also have a real opportunity to continue to improve and differentiate. Here's why ↴ 1. Fairness and Bias → Concern: AI systems may perpetuate or even amplify biases if the training data is not diverse or if the algorithms are not rigorously tested. → Candidate Worry: Will the AI unfairly disqualify me based on factors like my name, background, or employment history? 2. Transparency → Concern: Candidates often don’t know how AI evaluates their resumes or application responses. → Candidate Worry: How are decisions being made, and what criteria are used? If I’m rejected, will I even know why? 3. Loss of Human Touch → Concern: Over-reliance on AI may result in less personal interaction during the hiring process, which requires empathy and context. → Candidate Worry: Am I being overlooked because a machine doesn’t see my unique skills or context that a human recruiter might appreciate? 4. Accuracy of Matching → Concern: AI might prioritize keyword matching over context or nuance in a candidate’s experience. → Candidate Worry: Will the system recognize my transferable skills, or is it just searching for buzzwords? 5. Data Privacy → Concern: AI tools often process large amounts of candidate data, raising privacy and security issues. → Candidate Worry: How is my personal information being stored, shared, or used? 6. Over-automation → Concern: If AI is used too heavily in sourcing and screening, good candidates may slip through the cracks. → Candidate Worry: Am I being filtered out by rigid algorithms before anyone even looks at my application? 7. Algorithmic Accountability → Concern: Candidates want assurance that AI errors can be identified and corrected. → Candidate Worry: If the AI makes a mistake about my application, who’s accountable, and can it be reversed? How would I even know? How Companies and Vendors Can Address These Concerns ↴ →Self-audit their AI tools regularly for bias and fairness. → Provide transparency by clearly communicating how AI impacts the hiring process. → Use AI to assist, not replace, human decision-making. → Ensure data privacy through compliance with laws like GDPR or CCPA. 👆 These efforts can help build trust with candidates while ensuring that AI remains a tool to enhance, not diminish, the recruitment process. ✅ Candidates: Did I miss anything? ✅Companies: There is a massive opportunity to listen to job seekers and internal TA teams in the trenches as you develop the next phase of AI-powered TA tools. Exciting times, people! And I am here for all of it!
-
A candidate just applied to 500 jobs while sleeping. Their AI agent did the work. Read the JD. Filled the form. Wrote the cover letter. Uploaded the CV. Moved to the next role. Watch the demo and the agent doesn't pause. It doesn't hesitate at a missing field. It reasons through the page like a human would and keeps going. This isn't a future problem. It's already in your inbox . The screening industry was built on one assumption. That applications represent intent. That when someone applies, a human chose your company, read your JD, wanted this specific role. Agentic AI just broke that assumption. When applications cost zero effort, application volume tells you nothing. It's no longer a signal. It's noise. The recruiter still drowning in resumes in 2026 isn't fighting a hiring problem. They're fighting a math problem. And no amount of "faster screening" fixes math. The shift coming isn't smarter resume parsers. It's screening that ignores the resume entirely. Skills proven through assessments. Behaviour observed through simulations. Communication tested through video. Real signals an AI agent can't fake on behalf of a candidate. The recruiters winning in 2027 won't be the ones who screen faster. They'll be the ones who screen for things AI agents can't auto-submit. Is your screening still measuring the application? Or finally measuring the applicant? #FutureOfWork #ArtificialIntelligence #Recruitment #HRTech
-
When Algorithms Judge Teachers: The Ethical Minefield of Automated Screening 🧭This field experiment embedded GPT‑4 into a rural Ghanaian teacher hiring process. 697 applicants were randomly assigned to human‑only, human‑with‑AI assistance, or AI‑only screening. 🚨AI‑only screening boosted hiring success by 11 percentage points, a 73% improvement over human‑only. AI assistance yielded no gains because evaluators overrode AI recommendations more than 80% of the time, highlighting the promise of full automation and the pitfalls of hybrid approaches. Relevant Finding Trends 🎯 Hiring Success Improvement: AI‑only screening raised hiring success by 11 percentage points, a 73% boost over human‑only. 🔄 Human Override Prevalence: Evaluators overrode AI recommendations in over 80% of cases, negating AI‑assisted benefits. 📊 Grading Consistency Advantage: AI grades were more consistent (20% disagreement) versus humans (56% inconsistency). 🤖 Generative AI Usage by Applicants: 45% of essays were LLM‑generated—longer and less specific, complicating screening accuracy. 🎓 Performance Correlation Strength: AI‑only grades correlated 0.33 with in‑person outcomes, versus 0.05 (human‑only) and 0.13 (assisted). Study Limitations: ⚠️ Results pertain to a rural Ghanaian pipeline with GPT‑4; generalizability to other contexts is uncertain. ⚠️ Evaluator override biases and shifting perceptions of LLMs may limit external validity across settings. 3 Policy Maker Recommendations: ✅ Adopt full automation for large‑scale candidate screening when criteria are clear and standardized. 📚 Provide AI literacy training to evaluators, building trust and proper integration of AI suggestions. 🛡️ Implement continuous monitoring to assess AI‑only pipeline effectiveness and detect bias drift. Full publication: Awuah, Kobbina; Krenk, Urša; Yanagizawa‑Drott, David (2025). Automation with Generative AI? Evidence from a Teacher Hiring Pipeline, July 11, 2025. https://lnkd.in/edT-pkMG via Ezequiel Molina
-
One of our customers is currently exploring the introduction of AI bot–led video interviews for their Tech, Data, and Transformation roles. To sense-check how this might land with candidates, we asked a simple question: If you applied for a role and received an automated email asking you to complete a video interview with an AI bot, would you attend? The results are pretty telling. While AI-led video interviewing is often positioned as the “future of hiring,” nearly three-quarters of respondents (74%) expressed resistance when placed in the candidate’s seat. Only 10% said they’d willingly complete an AI bot interview, with a further 15% saying they would do so, but reluctantly. That reluctance matters. In competitive Tech, Data, and Transformation markets, even small points of friction can be enough to lose high-quality, in-demand talent. The strongest signal comes from the other side of the data: 28% would ask for an alternative 46% would decline the application entirely That means almost 1 in 2 candidates would walk away before speaking to a human. This raises an important question: who are we optimising for when we introduce AI interviews? AI video interviews can absolutely bring efficiencies, speed, consistency, scalability, and reduced recruiter workload. For high-volume or early-stage screening, they may have a place. But for specialist, senior, or highly competitive roles, the risk is clear: the very candidates organisations most want to attract are often the least willing to engage with impersonal processes. There’s also a perception challenge. Candidates often interpret AI-led interviews as: A lack of investment in the candidate experience A signal that human judgement comes later (or not at all) A one-way process rather than a two-way conversation For roles where relationship-building, communication, leadership, and collaboration are critical, removing human interaction too early can undermine the employer brand. The takeaway isn’t that AI interviewing is “bad”, it’s that blanket adoption is risky. Used thoughtfully, AI can support hiring teams. Used indiscriminately, it can quietly shrink your talent pool. Perhaps the future isn’t AI instead of humans, but AI alongside humans, with choice, transparency, and flexibility built in. Because when almost half of candidates say they’d opt out entirely, that’s not just a tech decision, it’s a commercial one.
-
I’ve interviewed hundreds of candidates, from campus hires to CXOs - and yet, I’m not sure we’re ready for what’s coming next. Just yesterday, I came across another update that stopped me in my tracks: Some BPOs in the West have started using AI-led interviews to screen candidates. It’s efficient. It’s scalable. But it also made me pause. Because while AI can assess keywords, tone, and speech patterns in milliseconds… Can it really assess empathy, adaptability, or leadership potential? And yet, whether we like it or not, this isn’t a distant future, it’s happening now. With the way hiring is evolving, AI-led initial screenings could become the norm within the next 5-6 years. So, if you’re a jobseeker, you have two choices: Resist it. Or prepare for it. And after much research and brainstorming with the best in the industry, here’s what preparation looks like: ✅ Master “structured storytelling”: AI doesn’t understand your personality, it understands clarity. Practice narrating your experiences in concise, structured answers with specific numbers and results. ✅ Train your emotional intelligence and make it visible: AI picks up signals like pauses, confidence, and consistency of tone. So, demonstrate empathy when discussing teamwork or conflict because it signals emotional awareness. ✅ Prepare for AI’s blind spots: AI isn’t great at understanding nuance, sarcasm, or cultural context - yet. If you have unconventional career paths, gaps, or pivot stories, practice framing them positively. But here’s my honest view in this space: AI can shortlist talent, but it can never truly understand it. Interviews aren’t just about who answers right, they’re about human connection, intuition, and understanding the “why” behind someone’s choices. That’s something no algorithm can replicate - yet. But the future is coming fast. So maybe the smarter strategy isn’t to fight AI…it’s to learn how to stand out in an AI-driven hiring world without losing your humanity. I’m curious - how do you feel about this shift? Are we ready for a hiring process where the first “person” you meet isn’t even human? #AIinhiring #futureofwork
-
New research shows that large language models judge identical text differently based solely on who they think wrote it. The content stays the same, but the evaluation shifts when an identity is attached. It’s a powerful reminder of why blind recruitment works — and why the same principle must apply when using AI in hiring. If AI is reviewing CVs or screening candidates, we need to remove names, nationality cues, gendered markers, and other identifiers so the model focuses on capability, not metadata. I’ve unpacked the study and its implications for ethical, inclusive AI in my latest article — including practical steps organisations can take. Join a community of multidisciplinary leaders for inclusive and ethical AI at ada.ai.