SMASH 2026 · Paper #22 · Result card

Damned if You Do(n't): How Epistemic Technology Spoils Expertise

Ayman Ajaj, Mayur Joshi, Mathieu Bouchard · University of Ottawa · Read the paper

The default radiologist case reads as shunned expertise. Two judges coded 36 comments with κ = 0.93.
case radiologistprofession Radiologist at a community hospitalstatements 4corpus 36 comments (default)judge A claude-haiku-4.5judge B claude-sonnet-4.6
Your case
Shunned expertise
Radiologist at a community hospital; adoption, others · second judge: Slopped (disagree) · 5/5 quotes verified verbatim
Damned if you don't
Outdated
the quadrant the same audience points to had you made the opposite adoption choice
Two-judge agreement (κ)
0.93
95% CI [0.82, 1.00] on 36 comments · stance κ 0.89, locus κ 0.96
Most common form (both judges agree)
Shunned
8 of 36 comments · default corpus

From the abstract

We advance a concept of spoiled expertise which takes distinct forms based on two dimensions: knowledge workers' stance of adoption of epistemic technology, and locus of evaluation of expertise. Together these two dimensions culminate into four forms of spoiled expertise: (1) slopped expertise, (2) lagging expertise, (3) shunned expertise, and (4) outdated expertise.

Evidence

Where does your situation sit in the 2×2?
Where does your situation sit in the 2×2?
★ = the overall reading of your case. Dots = each of your statements coded separately by the two judges. The dashed arrow points to the mirror quadrant: the 'damned if you don't' alternative.
Can the 2×2 be coded reliably?
Can the 2×2 be coded reliably?
Two LLM judges (different models, same codebook: the paper's definitions) coded every comment independently. Counts reflect the corpus as written, not how common each form is in the world.
Where do the judges disagree?
Where do the judges disagree?
Rows = judge A, columns = judge B. Off-diagonal cells are the ambiguous cases worth reading.

Paper vs. your run

MetricPaperYour run
Slopped expertise (adoption, self)This form captures experts who adopt epistemic technology and see their own expertise devalued by such adoption. Experts internalize the discourse tha…A 7 · B 7 · agreed 7corpus counts
Lagging expertise (non-adoption, self)This form captures experts who do not adopt epistemic technologies, but who internalize societal discourse that valorizes the capabilities and outputs…A 5 · B 5 · agreed 5corpus counts
Shunned expertise (adoption, others)This form captures experts who adopt epistemic technologies, and are stigmatized by others for doing so. This adoption is perceived by the expert's au…A 8 · B 8 · agreed 8corpus counts
Outdated expertise (non-adoption, others)This form illustrates experts who do not adopt epistemic technologies and are stigmatized by others for this resistance. These non-adopters become sym…A 9 · B 7 · agreed 7corpus counts
TransitionsSlopped → Shunned; Outdated → Slopped (§4)Shunned → Slopped (extrapolation (relabelled: not a transition the paper describes)); Shunned → Outdated (extrapolation)'extrapolation' = not in the paper
Empirical measurementnone (conceptual paper; proposes an empirical research agenda)κ = 0.93 between two LLM coderscodability, not prevalence
Agreement: clear-cut vs deliberately ambiguous comments—97% vs 83%30 vs 6 comments
Judges vs the corpus author's intended labels—κ A 0.96 · B 0.96synthetic corpus

Try next

Read this before sharing