💡

InsightHunt

Hunt the Insights

I

Itamar Gilad

Episode #126

Product Coach, Speaker, and Author

Evidence Guided (Book/Consulting)

🎯Product Strategy🚀Career & Leadership📈Growth & Metrics

📝Full Transcript

13,421 words
Itamar Gilad (00:00:00): You fake it, you do a fake door test, you do a smoke test, Wizard of Oz tests. We used a lot of those in the tabbed inbox by the way, one of the first early versions was actually we showed the tabbed inbox working to people. But it wasn't really Gmail, it was just a facade of HTML and behind the scenes and according to the permissions that the users gave us some of us moved just the subject and the sender into the right place. So initially the interviewer kind of distracted them and then showed them their inbox and then the top 50 messages were sorted to the right place more or less if we got it right. And people were like, "Wow, this is actually very cool." But it gave us some evidence to go and say, "Hey, we should try and build this thing." Lenny (00:00:43): Welcome to Lenny's Podcast where I interview world-class product leaders and growth experts to learn from their hard won experiences, building and growing today's most successful products. Today my guest is Itamar Gilad. Itamar, is a product coach, author, speaker and former longtime product manager at Google where you worked on Gmail, identity and YouTube. He also just published an awesome new book called Evidence-Guided: Creating High-Impact Products in the Face of Uncertainty. Itamar, has an important perspective on why and also how you can push your team and organization from an opinion-based decision-making process to a more evidence guided approach. In our conversation, Itamar, shares a number of very practical and handy frameworks that do just that including the confidence meter, metrics trees, GIST and the GIST board, plus his take on how people often misuse ICE for prioritizing ideas. Also, how you could make your OKRs more effective and so much more. Enjoy this episode with Itamar Gilad, after a short word from our sponsors. This episode is brought to you by Ezra, the leading full body cancer screening company. (00:01:49): I actually used Ezra, earlier this year unrelated ...

💡 Key Takeaways

  • 1Replace opinion-based roadmaps with evidence-guided validation loops.
  • 2Use the GIST framework (Goals, Ideas, Steps, Tasks) to connect strategy to execution.
  • 3Stop trusting high-confidence gut feelings; use a 'Confidence Meter' to objectively score evidence.
  • 4Distinguish between Value Created (North Star Metric) and Value Captured (Revenue/KPIs).
  • 5Validate ideas cheaply using 'Steps' like fake door tests or Wizard of Oz tests before writing code.

📚Methodologies (3)

The GIST Framework

by Itamar Gilad

🎯 Product Strategy

A meta-framework that breaks planning into four layers: Goals (outcomes), Ideas (hypothetical solutions), Steps (validation experiments), and Tasks (delivery work). It shifts focus from delivering features to achieving goals through validated learning.

Core Principles

  • 1.Goals: Define outcomes (e.g., Value Exchange Loop), not feature lists.
  • 2.Ideas: Collect hypotheses and prioritize them using ICE (Impact, Confidence, Ease).
  • 3.Steps: Break ideas into small learning milestones (experiments) rather than giant project phases.
  • +1 more...

"It's not about getting the bits to production, it's about getting the right bits to production."

#strategy#product
View Deep Dive →
The Confidence Meter

by Itamar Gilad

🚀 Career & Leadership

A visual tool measuring how much evidence supports an idea on a scale of 0-10. It moves from Opinions (low confidence) to Data/Estimates (medium) to Tests/Experiments (high confidence), forcing teams to admit when they are just guessing.

Core Principles

  • 1.Low Confidence (0-1): Opinions, themes, slide decks, and strategy documents.
  • 2.Medium Confidence (2-5): Anecdotal evidence, competitive analysis, data analysis, user interviews.
  • 3.High Confidence (6-10): Fake door tests, smoke tests, high-fidelity prototypes, A/B tests (Gold standard).
  • +1 more...

"Behind every terrible idea that was ever built, someone thought it was great."

#confidence#meter#career
View Deep Dive →
📈 Growth & Metrics

A model that balances 'Value Delivered' (North Star Metric) with 'Value Captured' (Business KPIs). These top metrics are broken down into a tree of leading indicators (inputs) that teams can directly influence.

Core Principles

  • 1.Value Exchange: Companies must deliver value (North Star) to capture value (Revenue). Measure both.
  • 2.North Star Metric: Measures core user value (e.g., WhatsApp: 'Messages Sent', not just daily active users).
  • 3.Decomposition: Break metrics down mathematically (e.g., Revenue = Traffic x Conversion x AOV).
  • +1 more...

"If in year one we have a billion messages sent, in year two two billion, probably we doubled the amount of value."

#metrics#trees#value
View Deep Dive →