undefined - Consumer Startup Metrics with Tom Blomfield | Startup School

Consumer Startup Metrics with Tom Blomfield | Startup School

In this episode of Startup School, YC Partner Tom Blomfield dives deeper into the metrics that matter most for consumer startups. Tom discusses paid and organic user growth, unit economics, net promoter scores, and the "magic moment" in your product that is most important to track.

โ€ขNovember 16, 2024โ€ข22:25

Table of Contents

0:01-6:19
6:21-13:48
14:00-22:11

๐Ÿ“ˆ What Growth Rate Will Make or Break Your Consumer Startup?

Growth Rates & User Metrics

Consumer companies live and die by their growth rates, and understanding these benchmarks is crucial for startup success.

Target Growth Rates:

  1. 15% month-over-month growth - This is the gold standard that will 5x your user base every year
  2. 10% monthly growth - Acceptable but slower, tripling your user base annually
  3. 5% or lower monthly growth - Unfortunately unlikely to achieve breakout success

Why Growth Matters More for Consumer Companies:

  • Monetization comes later - You often need to build network effects first
  • Scale drives value - The product becomes more valuable with more users
  • Competitive advantage - Growth creates barriers to entry through network effects

Key Insight:

"Growth is much more complex than simply headline user numbers." - Tom Blomfield

The real challenge isn't just hitting these numbersโ€”it's understanding what drives sustainable growth versus unsustainable growth patterns.

Timestamp: [1:02-1:25]Youtube Icon

๐ŸŒฑ How Did Monzo Reach 1 Million Customers Without Spending a Penny on Ads?

Organic vs. Paid Growth Strategy

The most successful consumer companies master organic growth before diving into paid acquisition, and there's a strategic reason for this approach.

The Organic Growth Advantage:

  • No direct marketing costs - Pure customer acquisition without advertising spend
  • Sustainable scaling - Growth that compounds without increasing costs
  • Product-market fit validation - Organic growth proves genuine user demand

Two Pillars of Organic Growth:

1. Virality

The mechanism where one user naturally introduces the product to others through normal usage:

  • Facebook's early tagging feature - Users tagged friends in photos, triggering email invites to non-users
  • Wordle's social sharing - Players posting those green and gray dots on social networks
  • Natural sharing moments - Points where users want to brag about achievements

2. Network Effects

The product becomes more valuable as more people join, following Metcalfe's Law:

  • WhatsApp messaging - Useless with one person, incredibly valuable with millions
  • Monzo's money transfer - Venmo-style transfers within the bank ecosystem
  • Group functionality - Joint accounts and shared expense pots

"We got to a million customers at Monzo before we spent any money on direct marketing or advertising." - Tom Blomfield

Strategic Questions for Your Product:

  • What are the sharable moments? - When do users naturally want to show off achievements?
  • How can sharing be frictionless? - Leverage iOS and Android sharing prompts
  • What multiplayer features could you add? - Shift from single-player to multiplayer experiences

Timestamp: [1:25-4:45]Youtube Icon

๐Ÿ’ฐ Are Paid Referral Schemes Really Worth It, or Just Expensive Organic Growth?

The Hidden Costs of Paid Referrals

Paid referral programs like "member get member" schemes might seem like organic growth, but they're actually paid acquisition in disguiseโ€”and come with unique risks.

Why Paid Referrals Are Actually Paid Acquisition:

  • Continuous cost requirement - Stop paying, stop getting referrals
  • Immediate expense - Unlike viral loops that pay back forever
  • Not truly organic - Growth dependent on financial incentives

Two Major Risks to Watch:

1. Cannibalization

The Problem: Paying for referrals that would have happened naturally anyway

  • Users who would have referred friends for free are now getting paid
  • You're essentially paying for customers you would have gotten anyway

Testing Strategy:

  • Run referral schemes only in certain cities or regions
  • Turn off programs periodically to measure natural referral rates
  • Compare organic referral rates with and without incentives

2. Fraud and Gaming

Real-World Examples:

  • Setting up fake Google ads to redirect to your referral link
  • Creating multiple fake accounts to milk referral bonuses
  • Exploiting system weaknesses for personal gain

"I had a friend who in the early days of Zipcar just set up a bunch of cheap Google ads that bid on Zipcar and then would redirect them straight to Zipcar and milk the referral scheme and so he drove free Zip Cars for a year and then got banned for life." - Tom Blomfield

The Economics Reality:

Viral loops and network effects pay back every day for the rest of the company's life, while ad spend disappears the moment you stop paying. Every 1-2% optimization in viral mechanics compounds forever.

Timestamp: [5:06-6:19]Youtube Icon

๐Ÿ’Ž Key Insights

Essential Growth Insights:

  1. 15% monthly growth is the breakout threshold - This rate will 5x your user base annually and signal true product-market fit
  2. Organic growth validates product-market fit - If users won't naturally share your product, paid growth won't solve fundamental issues
  3. Network effects compound forever - Unlike ad spend that disappears daily, viral mechanics and network effects pay dividends for the company's entire lifetime

Actionable Growth Strategies:

  • Identify sharable moments - Find natural points where users want to brag or share achievements
  • Build multiplayer features - Transform single-player experiences into collaborative ones
  • Test referral program effectiveness - Measure cannibalization by running geographic or time-based tests
  • Optimize viral loops continuously - Every 1-2% improvement compounds over the company's lifetime

Long-term Strategic Considerations:

  • Prioritize organic before paid - Build sustainable growth mechanisms before scaling with advertising
  • Design for network effects - Consider how your product becomes more valuable with more users
  • Monitor fraud in referral programs - Implement safeguards against gaming and abuse

Timestamp: [0:01-6:19]Youtube Icon

๐Ÿ“š References

People Mentioned:

  • Tom Blomfield - Former founder of Monzo (consumer online bank with 8 million UK customers) and Grouper (YC company building group social club and dating app)

Companies & Products:

  • Monzo - Consumer online bank that reached 1 million customers without paid marketing, now at 8 million UK customers
  • Grouper - YC company that built a group social club and dating app
  • Facebook - Early viral growth through photo tagging that invited non-users via email
  • WhatsApp - Prime example of network effects in messaging
  • Wordle - Viral growth through social media score sharing
  • Uber - Referral program offering free rides to both referrer and referee
  • Zipcar - Car sharing service that experienced referral program fraud
  • Duolingo - Language learning app with natural sharing moments at level completion

Concepts & Frameworks:

  • Metcalfe's Law - The value of a network is proportional to the square of the number of nodes in the network
  • Virality - Users naturally introducing the product to others through normal usage
  • Network Effects - Product becomes more valuable as more people join
  • Cannibalization - Paying for referrals that would have happened organically anyway
  • Organic vs. Paid Growth - Distinguishing between natural product adoption and paid user acquisition

Timestamp: [0:01-6:19]Youtube Icon

๐Ÿ“Š Why Can't You Trust Your Customer Acquisition Costs Without Proper Tracking?

Paid Growth Attribution & Tracking

Setting up proper tracking is the foundation of successful paid growth, yet many startups get this completely wrong from the start.

Essential Tracking Setup:

  1. Know where every user comes from - Facebook ads, Instagram, TV, newspaper, or other channels
  2. Use UTM parameters - The simplest method for pay-per-click campaigns
  3. Ask users directly - When UTM tracking fails (especially post-iOS changes), simply ask "Where did you hear about us?"
  4. Record attribution permanently - Store channel information in your database forever

Why Complex Attribution Often Fails:

  • First touch attribution - Often over-complicated for most startups
  • Last touch attribution - Can miss the full customer journey
  • Multi-touch attribution - Usually more hassle than it's worth

"You can get really convoluted with first touch attribution, last touch, multi-touch attribution... it's often way more hassle than it's worth." - Tom Blomfield

The Critical Database Strategy:

Record where each user came from forever - This allows you to monitor customer performance over time and discover hidden patterns in channel quality.

Timestamp: [6:21-7:15]Youtube Icon

๐Ÿ’ธ How a "Cheap" Customer Acquisition Channel Nearly Destroyed Monzo's Profitability?

The Hidden Dangers of Low CAC

Sometimes the cheapest customer acquisition costs hide the most expensive customersโ€”a lesson Monzo learned the hard way.

The Money-Saving Blog Disaster:

What Seemed Great:

  • Very cheap customer acquisition - Hundreds of users at low cost
  • High conversion rates - Users were signing up readily
  • Attractive channel metrics - All indicators looked positive

The Devastating Reality:

  • Customers loaded money onto cards - Normal onboarding behavior
  • Immediately withdrew cash abroad - Used ATMs for ยฃ1,000+ withdrawals
  • Generated massive costs - ATM fees and currency exchange losses
  • Negative lifetime value - These customers actually lost money for Monzo

"The customers it turns out were deeply unprofitable... the lifetime value of those customers was negative, the revenue and the profit they generated was negative for the company because they generated so much cost." - Tom Blomfield

The Strategic Response:

Shut down the entire channel despite attractive acquisition costs, because cheap CAC means nothing if customer lifetime value is negative.

Key Measurement Principle:

Measure CAC to active, monetized, retaining users - not just signups. You might have 80-90% drop-off in the first week, so track what it costs to generate users who actually stick around and perform like your best customers.

Timestamp: [7:41-8:58]Youtube Icon

โš–๏ธ Why Do Google and Meta Always Win When Startups Compete on Paid Growth?

The 80/20 Rule and Platform Dependency Risks

The best consumer companies maintain a specific ratio of organic to paid growth, and there's a critical reason why deviating from this ratio can destroy your business.

The Gold Standard Split:

  • 80%+ organic growth - The target for top consumer companies
  • 20% or less paid growth - Maximum healthy dependence on advertising
  • 100% organic is ideal - Facebook and WhatsApp achieved this in early days
  • 50/50 split is acceptable - But anything below 50% organic is worrisome

Why Paid Dependence Is Dangerous:

The Bidding War Trap:

  1. Competing companies bid against each other - Driving up acquisition costs
  2. Ad platforms optimize for maximum extraction - Google and Meta tune algorithms to maximize revenue
  3. Margins compress to zero - Companies pay more and more for the same customers
  4. Only platforms win - Google and Meta capture all the profit

"What happens is all these competing companies bid and bid and bid to get more and more customers and see they're making less and less profit on each customer... and at the end of the day only Google and Meta really win in that battle." - Tom Blomfield

Platform Risk Exposure:

iOS tracking changes can instantly wipe out half your business overnight. Many companies have died from sudden platform policy changes that broke their advertising tracking.

The Strategic Imperative:

"I've not seen any great consumer company get to true scale where more than 50% of their signups are coming from paid channels." - Tom Blomfield

Focus on organic growth first - viral loops and network effects that compound without increasing costs.

Timestamp: [9:00-10:57]Youtube Icon

๐Ÿ”ข How Can You Optimize Profitability One Customer at a Time?

Unit Economics & Per-Customer Analysis

Unit economics reveals the true health of your business by measuring profitability on a per-customer level, uncovering hidden patterns that aggregate metrics miss.

Unit Economics Formula:

Revenue per customer - Variable costs per customer = Unit economics

Monzo's Real-World Example:

Revenue Side:

  • $50 per customer annually - Base revenue generation

Variable Costs Include:

  • Plastic card production and replacement - Physical card costs when lost
  • Customer service contacts - More support requests = higher costs
  • Fraud losses - Account fraud incidents
  • Transaction and wire fees - Banking infrastructure costs

Why Granular Tracking Matters:

Customer Behavior Patterns:

  • Frequent travelers - Generated significantly more revenue
  • ATM heavy users - Incurred massive withdrawal costs
  • High-touch customers - Required expensive customer service

Channel Quality Differences:

Different acquisition channels brought customers with dramatically different cost profiles and revenue potential.

Strategic Applications:

  1. Optimize cost reduction - Target highest-cost customer behaviors
  2. Invest in profitable channels - Double down on channels bringing high-value customers
  3. Avoid scaling problems - Don't scale negative unit economics

"Rather than tracking these on a really broad basis, the more granular you can get on these costs the better." - Tom Blomfield

Critical Distinction:

Variable costs scale with customers (customer service, transaction fees), while fixed costs don't change with customer growth (engineering salaries, office rent).

"Scaling negative unit economics is very very dangerous... in the early days of Monzo we were at -ยฃ3 or -ยฃ4 per customer per year and we scaled to half a million customers before we fixed them." - Tom Blomfield

Timestamp: [10:59-13:48]Youtube Icon

๐Ÿ’Ž Key Insights

Essential Paid Growth Insights:

  1. Track attribution permanently - Store customer acquisition source in your database forever to monitor long-term channel performance
  2. Cheap CAC can hide expensive customers - Always measure customer acquisition cost against lifetime value, not just signup costs
  3. 80/20 organic-to-paid ratio is critical - Dependence on paid channels above 50% puts you at risk of margin compression and platform dependency

Unit Economics Breakthroughs:

  • Measure per-customer profitability - Revenue minus variable costs reveals true business health
  • Granular cost tracking beats broad metrics - Different customer segments and acquisition channels have vastly different economics
  • Never scale negative unit economics - Fix profitability before growing customer base to avoid massive losses

Strategic Risk Management:

  • Platform dependency kills margins - Google and Meta extract maximum value through bidding wars between competitors
  • iOS changes can destroy businesses overnight - Diversify growth channels to avoid single points of failure
  • Variable vs. fixed cost distinction matters - Only include costs that scale with customers in unit economics calculations

Timestamp: [6:21-13:48]Youtube Icon

๐Ÿ“š References

Companies & Products:

  • Monzo - Online bank example with $50 customer revenue and complex variable cost structure
  • Facebook - Example of 100% organic growth in early days
  • WhatsApp - Another example of achieving scale through purely organic growth
  • Google - Major advertising platform that benefits from startup bidding wars
  • Meta - Primary advertising platform alongside Google that extracts maximum value from advertisers

Technologies & Tools:

  • UTM Parameters - URL tracking method for pay-per-click campaign attribution
  • iOS Tracking - Apple's platform changes that broke advertising tracking for many companies

Concepts & Frameworks:

  • Customer Acquisition Cost (CAC) - How much you spend per channel to acquire each active, retaining user
  • Unit Economics - Per-customer revenue minus variable costs to measure individual customer profitability
  • Variable vs. Fixed Costs - Costs that scale with customers (variable) vs. costs that remain constant regardless of customer growth (fixed)
  • First Touch Attribution - Crediting the first marketing touchpoint for customer acquisition
  • Last Touch Attribution - Crediting the final marketing touchpoint before conversion
  • Multi-touch Attribution - Complex system for crediting multiple touchpoints in customer journey
  • Platform Risk - Business vulnerability to changes in major advertising or distribution platforms
  • Lifetime Value (LTV) - Total profit generated by a customer over their entire relationship with the company

Timestamp: [6:21-13:48]Youtube Icon

๐Ÿ“… How Do You Define "Active" When Your Customers Use Your Product Once a Year?

Consumer Retention Challenges

Measuring retention in consumer products is far more complex than B2B SaaS, where clear subscription contracts make churn obvious.

The Consumer Retention Dilemma:

Unlike B2B companies with recurring contracts, consumer companies face a fundamental question: What defines an active customer?

Usage Frequency Varies Dramatically:

  • Facebook - Users check multiple times daily
  • Airbnb - Customers might book every 6 months
  • Airlines - Annual or less frequent usage patterns
  • Monzo - At least one financial transaction per week

Defining Your Retention Metric:

Think about successful customers - those who really love your product. How often would they typically use your service?

The key is matching your retention definition to natural usage patterns, not forcing daily metrics on products meant for periodic use.

"For your business it's really important to think for a successful customer, someone who really likes the product, how often would they typically be using this service." - Tom Blomfield

Timestamp: [14:00-14:55]Youtube Icon

โœจ What's Facebook's "7 Friends in 10 Days" Secret and How Can You Find Yours?

The Magic Moment Discovery

When retention periods are long or hard to measure, finding your "magic moment" becomes the key to predicting long-term success.

What is a Magic Moment?

A user behavior or activity that correlates with or predicts long-term retention - the "aha moment" that hooks users for life.

Famous Magic Moment Examples:

Facebook's Discovery:

  • 7 friends added in first 10 days = overwhelmingly likely to become long-term users
  • No friends added in 10 days = much more likely to churn

Monzo's Banking Magic:

  • 3 friends added from phone book = 20 percentage points better retention
  • Venmo-style money transfer capability = the network effect driver

Airbnb's Approach:

  • Booking a stay and having a 5-star experience = long-term platform loyalty

How to Find Your Magic Moment:

Step 1: Analyze Your Best Users

Compare the behavior of your most engaged, long-term users to the rest of your customer base.

Step 2: Look for Correlation Patterns

Identify specific actions or milestones that predict long-term retention.

Step 3: Re-engineer Onboarding

Optimize your signup flow to push as many new users as possible to hit this magic moment immediately.

The Implementation Strategy:

Once you've identified your magic moment, re-engineer your product onboarding to ensure maximum users reach this point as quickly as possible.

"You can try to re-engineer your product onboarding to make sure that as many users as possible hit this magic moment as soon as possible." - Tom Blomfield

Critical Warning:

Don't get too fixated on precise definitions - whether it's 7 friends or 6 friends matters less than finding the general tipping point and optimizing for it consistently.

"For Facebook it probably didn't matter that much whether it was seven friends or eight friends or six friends, simply finding that kind of tipping point that looks about right from your metrics." - Tom Blomfield

Timestamp: [15:00-17:03]Youtube Icon

๐ŸŽฏ Why a +50 NPS is Life or Death for Consumer Startups?

Net Promoter Score (NPS) Fundamentals

NPS isn't just a nice-to-have metricโ€”for consumer companies, it's often the difference between viral growth and slow death.

NPS Calculation Breakdown:

Scale: 0-10 rating on "How likely are you to recommend this product to a friend?"

The Three Categories:

  1. Promoters (9-10) - Your advocates and evangelists
  2. Neutral (7-8) - Ignored in the calculation
  3. Detractors (0-6) - Actively unhappy customers

The Formula:

% Promoters - % Detractors = NPS

NPS Examples:

  • All detractors (0 ratings) = -100 NPS
  • All promoters (9-10 ratings) = +100 NPS
  • 50% promoters, 25% neutral, 25% detractors = 50-25 = +25 NPS

Consumer Startup NPS Benchmarks:

The Survival Threshold:

"If your net promoter score, your NPS, is not extremely high as a new consumer company, you're toast. You pretty much have to re-engineer the product to make it something that people love." - Tom Blomfield

Minimum Standards:

  • +50 NPS minimum - Essential baseline for consumer startups
  • +75 to +80 - Monzo's range during Tom's tenure
  • +96 - Tesla's exceptional score
  • Zero or negative - Old incumbents like cell phone companies and traditional banks

Why NPS Matters So Much:

It correlates extremely well with word-of-mouth referral - the lifeblood of consumer viral growth.

Strategic Application:

Disruption opportunity indicator - Industries with zero or negative NPS (like traditional banking or telecom) are ripe for disruption with great customer service and mobile propositions.

Timestamp: [17:04-19:05]Youtube Icon

๐Ÿ“Š How One Survey Method Change Destroyed Grouper's NPS Overnight?

NPS Collection Best Practices

Consistent measurement methodology is crucialโ€”changing how you collect NPS can create false signals that derail your entire strategy.

The Grouper Disaster Story:

Changed collection method โ†’ 20 percentage point drop overnight โ†’ Complete confusion about actual product performance

"We changed the collection method and the net promoter score decreased by 20 percentage points overnight. We couldn't figure it out." - Tom Blomfield

Critical NPS Collection Rules:

1. Maintain Absolute Consistency:

  • Same point in the app - Don't change where you ask
  • Same customer lifecycle timing - Keep the trigger point consistent
  • Same frequency - Monthly random samples or specific milestones
  • Same question format - Identical wording every time

2. Why Consistency Matters:

Changing any variable will change your responses and make your NPS scores jump wildly, making it impossible to distinguish between real product improvements and measurement artifacts.

The NPS Improvement Strategy:

Step 1: Ask the Follow-up Question

After the 0-10 rating, always ask a qualitative question: "Why do you like the product or what's wrong with it?"

Step 2: Focus on Detractors

Analyze all detractor feedback and systematically fix the issues they identify.

Step 3: Systematic Improvement

This is a surefire way to increase your net promoter score - directly addressing the specific problems that create detractors.

Implementation Framework:

  1. Establish consistent methodology - Pick your timing and stick to it
  2. Collect qualitative feedback - Always ask "why" after the rating
  3. Categorize detractor issues - Group similar complaints
  4. Prioritize and fix systematically - Address the most common problems first
  5. Track improvement over time - Monitor NPS changes from fixes

Timestamp: [19:08-20:22]Youtube Icon

๐Ÿ“ˆ What's the Ultimate Consumer Startup Health Checklist?

Complete Metrics Recap & Benchmarks

A comprehensive review of all critical consumer startup metrics with specific benchmarks and warning signs.

Growth Rate Targets:

  1. 15% month-over-month - The breakout success threshold
  2. 10% monthly - Acceptable but slower path
  3. 5% or below - Unlikely to achieve breakout success

Organic vs. Paid Growth Balance:

  • Minimum 50% organic - Essential for reaching scale
  • Above 50% paid growth - Long-term problem requiring fixes
  • Focus on virality and network effects - The sustainable growth drivers

Unit Economics Requirements:

  • Revenue per customer minus variable costs - Must be tracked meticulously
  • Negative unit economics - Must be fixed before scaling
  • Early Monzo example - Scaled to 500k customers at -ยฃ3 to -ยฃ4 per customer annually

Retention & Magic Moments:

  • Retention must flatten somewhere - Not continuously declining
  • Long retention periods - Look for magic moment indicators
  • Magic moment optimization - Re-engineer onboarding to maximize users hitting this point

Net Promoter Score Standards:

  • +50 minimum - Non-negotiable for consumer startups
  • Consistent measurement - Don't change collection methodology
  • Focus on detractors - Systematically fix their specific complaints

The Reality Check:

"These are all benchmarks. Your company and your industry may well be different. You may have off-the-charts organic growth and very poor unit economics like early Monzo, or you might have really good economics and pretty slow growth that rely on paid ads." - Tom Blomfield

Every business is different - use these benchmarks as guides while understanding your unique context and industry dynamics.

Timestamp: [20:24-22:11]Youtube Icon

๐Ÿ’Ž Key Insights

Essential Retention Insights:

  1. Match retention metrics to natural usage patterns - Daily metrics don't work for products used monthly or yearly
  2. Magic moments predict long-term success - Find the specific user behavior that correlates with retention and optimize onboarding around it
  3. Don't obsess over precise definitions - Focus on finding the general tipping point rather than debating whether it's 7 friends or 6 friends

NPS Strategic Breakthroughs:

  • +50 NPS is survival threshold - Anything lower requires product re-engineering for consumer startups
  • Consistency in measurement beats perfection - Changing collection methods destroys data reliability
  • Detractor feedback is gold - Systematically addressing detractor complaints is the most reliable way to improve NPS

Holistic Business Health:

  • All metrics interconnect - Growth rate, organic/paid split, unit economics, retention, and NPS work together
  • Context matters more than benchmarks - Your industry and business model may require different targets
  • Fix before scaling - Whether it's negative unit economics or low NPS, solve fundamental issues before growing

Timestamp: [14:00-22:11]Youtube Icon

๐Ÿ“š References

People Mentioned:

  • Tom Blomfield - Founder of Monzo and Grouper, sharing real-world experiences with consumer startup metrics

Companies & Products:

  • Facebook - Magic moment example: 7 friends in 10 days predicting long-term retention
  • Airbnb - Example of complex retention measurement due to infrequent usage patterns
  • Monzo - Magic moment: 3 friends added from phone book improving retention by 20 percentage points, NPS of +75 to +80
  • Tesla - Exceptional NPS score of +96
  • Grouper - Case study of NPS measurement methodology failure with 20-point overnight drop

Concepts & Frameworks:

  • Magic Moment - User behavior or activity that correlates with or predicts long-term retention
  • Net Promoter Score (NPS) - Scale 0-10 measuring likelihood to recommend, calculated as % promoters minus % detractors
  • Consumer Retention Definition - Determining appropriate usage frequency for measuring active customers
  • Promoters vs. Detractors - NPS categories where promoters (9-10) drive viral growth and detractors (0-6) indicate product problems
  • Retention Flattening - The point where customer churn stabilizes rather than continuously declining
  • Magic Moment Optimization - Re-engineering product onboarding to maximize users reaching the critical retention tipping point

Timestamp: [14:00-22:11]Youtube Icon