Portfolio

Shannon L.
Coleman

PhD  •  Secret Clearance

Product strategist and UX researcher working at the intersection of rigorous measurement and AI product practice.

Throughout my career I have been figuring out how to measure things that resist easy measurement, building systems honest about what they do not know, and knowing when a regression model answers the question and when you need to sit with a person for an hour and just listen. The best product decisions are built on both.

Case studies in research,
strategy, and product direction

The research background,
the product orientation

My path to product was not linear. I started in marketing intelligence and child development research, spent years at the PhD level in quantitative methods and psychology, and moved through applied research and strategy before landing in product leadership. Most of that work had a common thread: figuring out how to measure things that resist easy measurement, and building systems honest about what they do not know.

I work primarily with AI-focused product teams, with particular depth in healthtech, govtech, and fintech. The questions I keep returning to are about decision quality: not whether an AI system produces impressive output, but whether it actually improves the decisions users are trying to make, for which users, under what conditions, and how you would know if it stopped.

I am skeptical of demos. I am interested in what happens six months after launch. I think trust is a measurement problem and that most AI products are solving the wrong version of it.

I hold a current Secret clearance and have led research and strategy engagements throughout my career for Fortune 500 pharmaceutical companies, the Department of Defense, and early-stage startups. Earlier in my career I built a consumer and clinical trial recruitment research panel from zero to over 950 participants, an infrastructure project that shaped how I think about research operations and the conditions that make good research possible at scale. The scale of the work changes. The discipline does not.

Ground Truth on Substack:
rigorous AI product practice

I write about evaluation frameworks, failure mode analysis, governance design, and the organizational conditions that determine whether good product thinking actually ships. The focus is on what happens after the demo.

Ground Truth  •  Series Introduction
Introducing Ground Truth: A Publication on Rigorous AI Product Practice
Ground Truth  •  Part 1 of 4
A Practical AI Evaluation Framework for Consumer Products
Ground Truth  •  Substack
Currently publishing: A Framework for Rigorous AI Product Practice (4-part series). Next series: The Measurement Traps That Break Strategy. View all writing →
Get In Touch
Open to the right
conversation.