💡

InsightHunt

Hunt the Insights

E

Elizabeth Stone

Episode #90

Chief Technology Officer

Netflix

🚀Career & Leadership👥Team & Culture🔍User Research

📝Full Transcript

12,591 words
Elizabeth Stone (00:00:00): We can't really have any of the other aspects of the culture, including candor, learning, seeking excellence in improvement, freedom and responsibility if you don't start with high talent density. And in some ways, it's very reflective of Reed Hastings as founder of Netflix. So when he founded Netflix and grew the company over time, it was with a belief that there could be a different approach to building a company that would make it a place that people thrived in and loved being and would feel different than other places, both in the quality of that talent density, but even more importantly, the excellence and the outcomes. And that that's where people would derive a lot of sense of fulfillment. So it is very deeply seated at Netflix from its original days. And in order to do that, you have to really hold yourself to a lot of stuff that doesn't feel like natural human behavior. Lenny (00:01:06): Today my guest is Elizabeth Stone. Elizabeth is chief technology officer at Netflix, and as far as I can tell, the first economist to ever be named CTO at a Fortune 500 company. Prior to this role, Elizabeth was vice president of Data and Insights. Before Netflix, she was vice president of science at Lyft, COO at Nuna, a trader at Merrill Lynch, and an economist at Analyst Group. In our conversation, we cover a lot of ground. We talk about how an economics background has helped Elizabeth in her career and why she expects to see more economists rise in the ranks of tech companies. She shares some of her secret sauce for rising so quickly at so many companies so consistently. We delve into Netflix's very unique culture of high talent density, radical candor, and freedom and responsibility. We also talk about the structure that Netflix has for their data and user research teams, which she believes is a part of Netflix's secret to success. We also get into what biking and triathlons have taught Elizabeth about life and how she brings that into her w...

💡 Key Takeaways

  • 1Dedication is not about long hours; it is about reliability and the 'last 5%' of polish that signals world-class work.
  • 2Economics provides a critical lens for product: look for unintended consequences and incentives rather than assuming rational user behavior.
  • 3Talent density is the prerequisite for 'Freedom and Responsibility'; you cannot remove process controls without first ensuring every team member is a high performer.
  • 4Replace performance reviews with continuous feedback; the 'Keeper Test' should be a weekly mental model, not an annual event.
  • 5To scale as a leader, you must become a 'translator' who can explain technical constraints to business partners and business strategy to engineers.
  • 6Centralize data and insights teams to maintain objectivity; embedded teams often fall into the trap of telling stakeholders what they want to hear.
  • 7Use 'The Keeper Test' to reduce anxiety: knowing where you stand instantly is less stressful than wondering until a review.

📚Methodologies (3)

🚀 Career & Leadership

A four-step management loop that combines high standards with active support. Instead of just rejecting work that doesn't meet the bar, the leader actively participates in the refinement process to upskill the employee.

Core Principles

  • 1.Step 1: Set the 'World-Class' Expectation: Explicitly state that the goal is excellence, not just completion. Clarify that the 'last 5%' of effort is what matters most.
  • 2.Step 2: Diagnose the Specific Gap: Don't just say 'fix this.' Identify exactly where the logic, communication, or execution failed to meet the standard.
  • 3.Step 3: Jump in to Fill the Gap: Do not just delegate the fix. Co-author the document or pair-program the solution *with* them to demonstrate what 'good' looks like.
  • +1 more...

"I can both give the feedback... and then jumping into the document and helping. So I feel very strongly about... 'Let's work on this together,' and then through that, help people uplevel themselves."

#'fill#coaching#career
View Deep Dive →
The Keeper Test Protocol

by Elizabeth Stone

👥 Team & Culture

A rigorous mental model used by managers to assess team composition continuously rather than annually. It frames retention as an active choice rather than a default state.

Core Principles

  • 1.Step 1: The Critical Question: Ask yourself, 'If this person told me they were leaving for a competitor today, would I fight hard to keep them?'
  • 2.Step 2: Immediate Action: If the answer is 'no' (you would be relieved), you must initiate a transition conversation immediately.
  • 3.Step 3: Continuous Calibration: This is not a quarterly review process; it is a mental check a manager performs regularly.
  • +1 more...

"If I'm asking myself the question, 'If this person on my team came to me and said, I'm leaving today... would I do everything I could to keep them at Netflix?' If not, then I should be having that tough conversation."

#keeper#protocol#team
View Deep Dive →
🔍 User Research

A structural approach to data organization where Data Science, Engineering, and Consumer Insights (User Research) are centralized and unified, rather than embedded and siloed.

Core Principles

  • 1.Step 1: Centralize for Independence: Keep data teams reporting into a central Data executive, not the business unit leaders they support. This ensures their primary loyalty is to objective truth, not shipping a feature.
  • 2.Step 2: Merge Quant and Qual: Collocate Data Science (behavioral) and Consumer Insights (attitudinal/research) in the same org to create a 'full-stack' view of the user.
  • 3.Step 3: Mandate Opinionated Partnership: The data team's job is not just to query SQL; it is to have a perspective on the business problem and challenge the product team's assumptions.
  • +1 more...

"The benefit we get is... it also allows us to be really objective. That is probably the most important thing, that our job is not to tell the story that someone wants to hear with the data."

#objective#truth#architecture
View Deep Dive →