I Am Not a Robot: AI and Leadership Hiring - Part II

Pitfalls, Risks & Solutions

While AI offers efficiency and scale in executive search, some pitfalls are currently limiting its effectiveness in high-level hiring. None are insurmountable. 

In Part 2 of our series examining how AI is transforming executive search and its impact on global executive talent acquisition, senior Amrop Partners unpack the downsides in data-driven leadership hiring processes.

How can AI users get the best of both worlds in executive and board hiring?

Download the report.

Amrop Robot II AI In Executive Search (1)

Teething Problems

AIs still suffer missing information and lack nuance. They risk bias and narrow-mindedness. And they are increasingly training on AI-generated data, leading to potential 'model collapse'. Executive and board hiring teams need to address a host of issues that can compromise a hire.

Read the full report

I am Not a Robot II

Download

For basic executive hiring routines such as primary research into candidates or companies, the scope of AIs seems unparalleled. Sweeping through vast fields of data, they summarize their findings at the speed of light. But their true depth and scope is still limited. A bot depends upon publicly available, internet-based data - but the landscape is full of blind spots and quite often, rubbish. Consider the CV. “CV data is possibly more useful for straight skills-based work,” explains Jamal Khan, Managing Partner of Amrop in Australia. “But we haven't yet found an AI product that can fully perform the desk-based aspect of the researcher’s role.” 

When it comes to companies, data about listed organizations is openly available. Deeper, qualitative information is not. Privately held firms are even more obscure.

“AI is missing information,” says Amrop Global Board Member Mikael Norr, “but also silent knowledge about companies, people, environments, owners.” As an executive search consultant, “you know by heart which group owns a given company, and that it's impossible to recruit from there. You know that a candidate was successful in one environment, but not another.

Lost nuance

“I recently had three candidates with similar backgrounds,” recalls Mikael Norr. “ChatGPT described them in exactly the same way. So you can’t rely on AI - you need your own thoughts, opinions and views. We don't find it accurate enough.” When he compares an AI result with the output of an experienced consultant and researcher, “it takes a bit longer, but it's more accurate.” Mia Zhou is a Director of Amrop China. An AI can also hallucinate, fabricate and try to cover its mistakes. “It started to get things wrong, saying that things were correct when they were not,” recalls Jamal Khan. “So it learned to behave just like a human would if they were made to feel incompetent.” 

Narrow-mindedness and bias

Is AI driven executive search a real possibility? It’s tempting to assume that machines think logically. But AIs can suffer errors or unfair outcomes. Faults can include under-representing certain groups, the subjective judgment of human labelers, or algorithms that favor certain outcomes.

“The current reality (it will probably change), is that AI works better on a simple profile with languages, hard skills,” says Mikael Norr. “However, a CEO in a broad role involves nuance and softer skills, such as being inspiring. It's much more difficult to work with AI in those cases.” At senior levels, keyword filtering and automation can mislead, signals Jamal Khan. “The rules-based AI system often rejects qualified candidates if their CVs aren’t ‘optimized’ with the right terms. But experienced recruiters can infer skills from context. They know that a CFO automatically knows about payroll. I'm sure GenAI will get there, but I'm not sure it's there yet.”

Read the full report.

Outliers often bring innovation and resilience to the table. But AI tends to overlook unconventional candidates.

Breaking out of the echo chamber

Outliers often bring innovation and resilience. But AI tends to overlook unconventional candidates. “Value isn’t created by the leaders with the most polished resumés, but by those who lived through black swan moments, crisis, systemic shocks.” Their resilience and agility is invaluable, argues Amrop Global Board Member Oana Ciornei. “But if you’re using an AI to filter, these people will not match the algorithmic norm.” Moreover, online CVs may omit controversial (and interesting) career moments. She seeks leadership knowledge created “in the space of the unexpected.” 

In a recent article,3 IBM writers signaled a problem: AI models increasingly learn from other AI-generated data, weakening the results. “Model collapse progresses as errors compound with successive generations.” Subsequent iterations cause late model collapse: “the data distribution converged so much that it looked nearly nothing like the original.” But as ever, there are answers.

The opacity of AI decisions makes it difficult for recruiters to ‘show their workings’ and demonstrate 'procedural justice'. “Not being able to see the thought process or structure of how an AI searched makes us trust the output less,” says Costa Tzavaras, Amrop's Global Programs Director. “If I go into a database or any digital system and select the parameters myself: sectors, functions, education, I know the outcome is based on that. We’re still not quite trusting that black box.”

All eyes on the control panel

Jamal Khan recalls how LinkedIn’s automated messaging function once took off and flew solo. “I wrote a message and didn't notice before clicking ‘send’ that the AI had rewritten it: a terrible cheesy missive. No-one responded, whereas 40 to 50% normally do. And it kept doing it.” He quickly realized that the AI setting launched by default and had to be actively turned off. Mikael Norr: “We cannot be totally sure who is talking to us… fraud is omnipresent.” Jamal Khan also warns against using automation for outreach in business development. “You can't mass market and send 200 emails out. You’re lucky if you get 2% response. That’s not the business we’re in.”

Symbiotic solutions

To harness AI, human expertise is still essential. Experienced consultants bring lateral thinking, EQ and contextual understanding. Human involvement is critical to counteract bias, interpret complex profiles, and build trust with clients and candidates. Given this symbiosis, the potential is immense.

Harnessing the power of artificial intelligence in leadership recruitment

Misinterpretations, hallucinations, errors. Missed candidates, black boxes. Despite their pitfalls, AIs remain invaluable tools with unprecedented power. The teething problems can be overcome with human oversight and cross comparison — checking and refining an AI’s responses. We have discussed how AIs risk filtering out innovators. One solution is to deliberately prompt the machine to look for atypical, innovative profiles. Another is rigorous scouting and skilled interviewing. This probes beyond ‘classic’ responses to unearth authentic (and unusual) characteristics and views. Lateral thinking is another human quality. “That instinct that says, if not this sector, there's another interesting one with similar challenges; we might find somebody there,” says Costa Tzavaras.

Human connectivity: never more vital in executive search

“Our work is all around the quality of the people. Trust,” says Job Voorhoeve, Amrop Netherlands. “And AI doesn't generate trust at the moment: it’s designed by humans and biased by default.” He calls for realism. "Any machine needs maintenance. So do people. So it's nothing new.” What about the AI who lied? Mikael Norr: “We cover that in our prompts. The ability to prompt properly is vital.” Then the learning can be shared globally. Working in teams helps challenge assumptions, reduce bias, and uncover better candidate matches.

C-suite recruitment: science meets art

Human interaction also triggers unparalleled creative insights. Costa Tzavaras: “The interplay of experience sparks interesting alternatives, left and right turns to uncover all possibly appropriate candidates, versus just matching a job title with industry, sector and school. That triggering that happens in a team is hugely valuable and AI can't approximate it.”

Let's recall the value of live interviewing. Not only does this reveal innovative minds and core drivers, it also unmasks rote answers: “Get out from behind the screen with senior candidates as fast as you can,” advises Costa Tzavaras. Going forward, real-world testing will be vital: simulations and live role plays to assess candidates under pressure, revealing traits that AI or digital interviews might miss. Live group interviews offer insights that escape virtual meetings.

Mikael Norr: “Our normal drill, especially with CEO recruitments, involves two consultants interviewing together and comparing notes, getting a sense of the atmosphere in the room. I just concluded a big CEO assignment. The final candidates met the whole board on Teams. But you can’t sense the dynamics if on one side you have the candidate and on the other, 10 people on screen. It was a monologue and some questions. Now, if you let the candidate into a room with these people and try to evaluate their leadership, you can clearly see what happens.”

The beauty of the unpredictable

“The human being is a volatile animal, moving up and down through life stages,” says Job Voorhoeve. "So in terms of predictive analytics for talent acquisition, looking at core data, you can probably see some information, and we use assessments for that. But the cultural dynamics and role context only surface after analysis by specialized executive search professionals. We have seen many people. Our instinct also tells us a great deal. But we also have a lot of experience in the traits needed to support key stakeholders: the CEO, management team, the board, owner or shareholder and other stakeholders. There are so many inconstant variables. Oana Ciornei agrees. “You change your views, incorporate new ideas during your life. You form your principles. You will have a lot of inconsistency as well.”

It is in this evolution that human richness lies, and which still escapes the artificial gaze.

SOURCES

1 Winick, E., (October 10, 2018). Amazon ditched AI recruitment software because it was biased against women. MIT Technology Review.

2 Gassam Asare, J. (June 23, 2025). What The Workday Lawsuit Reveals About AI Bias—And How To Prevent It. Forbes.

3 Gomstyn, A., Jonker, A., (2024). What is model collapse? IBM.

Read the full report

I am Not a Robot II

Download