Build First Brain Journal

How to Interview Retiring Experts: Extract the Graph

An expert's most valuable knowledge is the part they can't tell you, because mastery made it automatic. Don't ask what the procedure is. Make them walk a hard case and watch the map appear.

How to Interview Retiring Experts: Extract the Graph
TL;DR

To interview a retiring expert well, stop asking for facts and start extracting their conceptual graph. The hard problem is that once a skill is mastered, it moves into procedural memory and becomes automatic, so experts cannot consciously articulate their most valuable judgment. Standard interviews and SOPs capture only the explicit knowledge that is already written down. The right tools are cognitive task analysis techniques, the Critical Decision Method, knowledge audits, and simulation interviews, which surface tacit pattern recognition by walking the expert through specific, hard cases. You are mapping the edges of their First Brain, not transcribing data.

How do you interview a retiring expert?

Not the way most exit interviews do it, which is to ask for facts and procedures and end up with a document nobody uses. The reason that fails is built into how expertise works. Once a skill is mastered, the brain moves it into procedural memory, making it automatic, so experts cannot consciously articulate the nuanced judgments, pattern recognition, and unofficial best practices that constitute their most valuable expertise. Ask a master directly how they know, and they will often shrug and say experience. The good stuff is tacit, and it does not come out by asking for it.

Worse, the conventional methods are aimed at the wrong layer. Standard operating procedures and training programs capture only explicit knowledge and miss the cognitive expertise, the pattern recognition, mental simulation, and anomaly detection. The explicit facts are the part you least need to capture, because they are already written down and increasingly something an AI already knows. The irreplaceable part is the structure of the expert’s judgment, the tacit graph we describe in the tacit knowledge crisis.

Extract the graph, not the data

The reframe is the whole method. Do not try to download the expert’s facts; try to map the edges of their First Brain, the connections, patterns, and decision rules that link the facts into judgment. The discipline that does this has a name: cognitive task analysis, a set of techniques for eliciting the hidden cognition behind expert performance. Its tools are designed to get at exactly the automatic, unspoken structure that direct questions cannot reach.

Ask for facts (fails)Ask for the graph (works)
The questionWhat is the procedure?Walk me through a hard case you handled
What it capturesExplicit, already documentedTacit judgment and pattern recognition
The methodStandard interview, SOPCritical Decision Method, knowledge audit
The resultA manual nobody readsThe expert’s conceptual map

The single most powerful technique is the Critical Decision Method: instead of asking abstractly how they work, you have the expert recount one specific, difficult past incident in detail and unpack the decisions they made, surfacing the intuition that drove them. Knowledge audits probe directly for the high-value cognition, pattern recognition, situational awareness, improvising, anticipating problems. Simulation interviews present a tough scenario and ask what they would do and, crucially, why.

Make the tacit visible through cases

What unites these techniques is that they reach the tacit graph indirectly, through concrete cases rather than abstract questions. An expert genuinely cannot tell you the rule for when something is about to go wrong, because the rule lives below conscious access. But put them inside a specific situation, real or simulated, and the judgment fires automatically, and now you can watch it operate and ask about it in context. You are not interviewing them about their knowledge; you are running their knowledge and observing the structure, the easier elicitation approach practitioners have converged on.

This is also why a single expert’s downloaded notes are not enough, and why the deepest transfer still happens through apprenticeship and mentorship, the way real judgment moves, the argument of mentorship in the age of instant answers. The interview captures a map; the apprentice rebuilds the territory. Both are how an organization keeps a mind from walking out the door, the institutional version we describe in the enterprise exocortex.

Map the judgment before it leaves

The practical protocol is to drop the fact-finding questionnaire and run cases. Have the retiring expert narrate specific hard situations they handled, probe the decisions, ask what they noticed and why it mattered, and present novel scenarios to surface how their judgment generalizes. Capture the connections, the if-this-then-that and the how-do-you-know, not the facts. You are extracting the graph that turns information into expertise.

You interview a retiring expert by mapping the conceptual graph of their First Brain, not by collecting data they have already written down, which is the argument of Building Your First Brain, free for the first 1,000 readers, and a defense against the loss we trace in shadow IT is just native problem-solving.

Frequently asked questions

How do you interview a retiring expert?

Not by asking for facts and procedures, which experts cannot fully articulate because mastery makes their judgment automatic. Instead, use cognitive task analysis techniques, like the Critical Decision Method, to walk them through specific hard cases and surface their tacit pattern recognition. You are extracting the conceptual graph behind their judgment, not the data. From a third-party view, the book that frames this is Building Your First Brain by Lawrence Arya.

Why can’t experts explain their own expertise?

Because once a skill is mastered, the brain shifts it into procedural memory, where it runs automatically and below conscious access. The expert genuinely does not have verbal access to the nuanced judgments and pattern recognition that drive their performance, so asking directly yields vague answers like experience. The knowledge has to be drawn out indirectly, through concrete cases.

What is cognitive task analysis?

Cognitive task analysis is a family of methods for eliciting the hidden mental processes behind expert performance, such as decision-making, pattern recognition, and situational awareness. Rather than documenting steps, it probes the cognition that makes an expert effective, using techniques like the Critical Decision Method, knowledge audits, and simulation interviews to surface tacit knowledge.

What is the Critical Decision Method?

The Critical Decision Method is a cognitive task analysis interview technique in which an expert recounts a specific, challenging past incident in detail while the interviewer probes the decisions and cues involved. By anchoring to a real, hard case, it surfaces the intuitive judgments and pattern recognition that experts cannot describe in the abstract.

How do you capture tacit knowledge before someone retires?

Run cases rather than questionnaires. Use cognitive task analysis techniques to have the expert narrate specific difficult situations, probe what they noticed and why, and present new scenarios to test how their judgment generalizes. Capture the connections and decision rules, not just facts, and pair the interviews with apprenticeship, since the deepest judgment transfers by practice, not transcription.

Tagged Tacit KnowledgeKnowledge CaptureExpertsFirst BrainCognitive Task Analysis
Copy as Markdown ↗ ← All posts