The Confidence Meter
by Itamar Gilad • Product Coach, Speaker, and Author at Evidence Guided (Book/Consulting)
Itamar is a veteran product coach and former Product Manager at Google (Gmail, YouTube, Identity). He is the author of the book 'Evidence-Guided: Creating High-Impact Products in the Face of Uncertainty' and created the GIST framework.
🎙️ Episode Context
Itamar Gilad challenges the traditional "opinion-based" product development model, advocating for an "evidence-guided" approach. Drawing from his experiences with the failure of Google+ and the success of Gmail's tabbed inbox, he introduces practical frameworks like GIST, the Confidence Meter, and Metrics Trees to help teams validate ideas cheaply and align on outcomes.
Problem It Solves
Prevents the 'HiPPO' effect (Highest Paid Person's Opinion) and subjective scoring in prioritization frameworks like ICE.
Framework Overview
A visual tool measuring how much evidence supports an idea on a scale of 0-10. It moves from Opinions (low confidence) to Data/Estimates (medium) to Tests/Experiments (high confidence), forcing teams to admit when they are just guessing.
🧠 Framework Structure
Low Confidence (0-1): Opinions, theme...
Medium Confidence (2-5): Anecdotal ev...
High Confidence (6-10): Fake door tes...
Action: Only invest heavy engineering...
When to Use
During prioritization meetings to objectively challenge enthusiastic founders or stakeholders.
Common Mistakes
Giving a high confidence score because a competitor has the feature (this is a fallacy; competitors also guess).
Real World Example
Google+ had huge strategic backing (Low Confidence evidence treated as high), leading to failure. Gmail Tabs started small with low confidence and built evidence up.
Behind every terrible idea that was ever built, someone thought it was great.
— Itamar Gilad