undefined - Josh Woodward: Google Labs is Rapidly Building AI Products from 0-to-1

Josh Woodward: Google Labs is Rapidly Building AI Products from 0-to-1

As VP of Google Labs, Josh Woodward leads teams exploring the frontiers of AI applications. He shares insights on their rapid development process, why today’s written prompts will become outdated and how AI is transforming everything from video generation to computer control. He reveals that 25% of Google’s code is now written by AI and explains why coding could see major leaps forward this year. He emphasizes the importance of taste, design and human values in building AI tools that will shape ...

March 18, 202551:16

Table of Contents

Segment 1
Segment 2
Segment 3
Segment 4
Segment 5
Segment 6

🎮 Winning the Game

Garry Tan discusses how people aren't prepared for the massive changes coming in business and technology - changes that are "super good news for anyone running a business."

The conversation shifts to a viral meme "learn to cook, loser" started by Paul Graham, where the hosts discuss how this phrase represents a philosophy of high-agency living and actually building things of value.

They admire Paul Graham's ultimate success story - building YC into one of the greatest companies of all time, then moving to Europe to focus on writing and family.

"Is Paul Graham like the definition of success? Basically built one of the greatest companies of all time, YC, and then it started working well and then just bails to Europe where he's living in the woods writing and being with his family... did he just pull the ultimate move and it worked out perfectly?"

🎓 Being the Harvard of Startups

Garry describes Y Combinator as a "miracle" that works for "relatively mysterious reasons that are almost too obvious."

The YC formula:

  • Find things that could be really big
  • Give founders money
  • Put them in a room with other top 1% founders
  • Magic happens - 5-10% of companies become worth $1B+
  • Take only 7% equity

YC intentionally focuses on people who wouldn't normally have access to capital or networks.

Garry explains how YC's institutional reputation comes from:

  • Paul Graham's original thinking and clear communication
  • The combination of high standards with a welcoming, family-like atmosphere
  • Being both "very earnest and very formidable"

"Jessica once cut a Founder's fingernails before he went on stage at demo day... it's sort of at once very exacting with very high standards but then also very welcoming and almost family-like."

💰 How YC Outperforms Most Silicon Valley Investors

Despite a surprisingly simple process, YC consistently outperforms other investors:

  • 10-minute interviews (!)
  • Standard 7% equity deal for everyone
  • Simple online application

The results are extraordinary:

  • Each batch creates approximately $3 billion in market cap
  • About 5% of companies become unicorns
  • YC runs batches 2-4 times per year

Garry mentions the Airbnb investment as an example of YC's success, where under $20,000 invested became $2 billion when Airbnb IPO'd.

YC's value creation per employee is staggering:

  • Approximately $20 million per year per employee in market cap value
  • Close to $100 million per year per employee in overall value created

"Simple things work."

🦄 Spotting Extreme Winners

When asked about identifying the biggest winners early on, Garry reveals they often look similar to average companies at the beginning.

Using Brian Armstrong (Coinbase founder) as an example:

  • Solo software engineer at Airbnb working on anti-fraud
  • Had never started a company before
  • Needed help with basics like product launches and fundraising

YC looks for "highly technical people who are just smart and earnest."

Garry emphasizes how important this approach is in 2024, as large language models have changed the game:

  • LLMs can now do almost anything knowledge workers can do
  • Anyone with the right tools can write software without coding
  • This represents a "profound moment for all entrepreneurs"

📚 References

People:

  • Paul Graham - YC co-founder, mentioned for his success and the "learn to cook, loser" meme
  • Jessica Livingston - YC co-founder, Paul Graham's wife
  • Brian Armstrong - Coinbase founder, mentioned as an example of a YC success story

Companies:

  • Y Combinator (YC) - The startup accelerator discussed throughout
  • Airbnb - Mentioned as a major YC success story
  • Coinbase - Mentioned as another major YC success

Concepts:

  • "Learn to cook, loser" - Viral meme representing high-agency living and building valuable things
  • Power law returns - The concept that a small percentage of investments drive most returns
  • Large language models (LLMs) - Discussed as transformative technology for entrepreneurs

💎 Key Insights

  • YC's success formula combines high standards with a welcoming atmosphere, creating a unique environment that produces extraordinary results
  • Despite using a simple process (10-minute interviews, standard 7% equity), YC consistently outperforms other investors
  • Each YC batch creates approximately $3 billion in market cap
  • The most successful founders often start with basic needs and look similar to average founders - they're typically "highly technical people who are smart and earnest"
  • Large language models are transforming entrepreneurship, making it possible for anyone to build software without traditional coding skills
  • YC's investment returns are remarkable across the board - even their bottom quartile investments return 3.3x (compared to industry standard where only top 25% of VC investments make money)

💵 Capital-as-a-Service

Garry discusses the concept of "Capital-as-a-Service" - automating funding decisions for startups through data and AI.

He explains how YC's current process works:

  • 14 equal group partners including Garry review applications
  • Actual humans conduct the 10-minute interviews, not AI
  • Partners work directly with founders for 10-12 weeks
  • Continues as a relationship since YC owns 7% as a seed investor
  • Very high-touch with individual attention

Garry outlines how the "Capital-as-a-Service" concept could work:

  • Connect metrics, Stripe account, bank account, QuickBooks
  • Let AI analyze and rank whether the business is real
  • Automate funding decisions based on data thresholds
  • Deposit money directly into the founder's bank account

The hosts reference Chamath Palihapitiya's "eightball" experiment at Social Capital:

  • Connected company data for analysis
  • Benchmarked against other companies in the category
  • Evaluated metrics like retention
  • Promising but "too early" in its implementation

They discuss a related example of a creative approach to AI:

  • Someone used ChatGPT to create a content website
  • Instead of using AI as an agent, they positioned themselves as the human agent
  • Had the AI generate the strategy and ideas
  • Reportedly reached $20,000 in monthly revenue within three months

🚲 How Garry Hustled at 14 to Get His Family Into Financial Security

Garry shares his origin story of growing up in modest circumstances:

  • Family was sometimes food insecure
  • Father was a foreman in a machine shop
  • Mother worked two jobs as a home health aide and certified nursing assistant
  • Lived in apartments in Fremont, CA, "in the shadow of Silicon Valley"

Despite financial challenges, Garry had access to technology:

  • Father invested in computers despite financial struggles
  • Their first computer was an IBM PC XT
  • "Reality poor but rich in access to computers"

At 14, Garry started his entrepreneurial journey:

  • Won awards for web design in junior high
  • Started an underground newspaper with friends
  • Created a website called "Online Zen" that attracted thousands of readers
  • People wrote letters to the editor not knowing they were communicating with 14-year-olds

"When you're on the internet, nobody knows that you're a dog... people would just write letters to the editor like we were a legitimate publication."

Garry's first business venture:

  • Used the Yellow Pages to cold-call businesses
  • Deepened his voice to sound older on calls
  • Marketed himself as an "award-winning web designer"
  • Got hired by a local web design firm that made city websites
  • Earned $7-10 per hour doing HTML and graphic design
  • Rode his bike to work

The web design firm had an interesting story:

  • Called InfoLane
  • Founded by a "neckbeard Unix guy" who walked into a local bank
  • The bank manager became the co-founder and invested his own money
  • This was how businesses started in 1993-94

Garry's work eventually allowed him to help his family achieve the American dream:

  • Helped his parents with a down payment on a house
  • Family moved from apartments to their own home
  • Parents still live in that house in Fremont
  • Garry is currently helping them remodel it

The segment ends with Shaan finding an old blog post from Garry in 2001:

  • Predicted how social media would change human interaction
  • Foresaw that people would check blogs instead of meeting in person
  • Accurately described what would become Instagram, Facebook, and the news feed

📚 References

People:

  • Chamath Palihapitiya - Mentioned for his "Capital-as-a-Service" experiment at Social Capital
  • Garry's parents - Discussed in his origin story

Companies:

  • Y Combinator (YC) - Discussed in context of their funding process
  • Social Capital - Mentioned for their "eightball" experiment
  • InfoLane - Garry's first employer, the web design firm
  • Fremont Bank - Where Garry's boss was a regional manager

Concepts:

  • Capital-as-a-Service - Automated funding decisions based on data
  • The "eightball" - Social Capital's tool for analyzing company metrics
  • Yellow Pages - How Garry found his first clients

Technology:

  • IBM PC XT - Garry's first computer
  • ChatGPT/AI - Discussed as a tool for business creation

💎 Key Insights

  • YC's current process is highly personal and human-driven, with 14 partners reviewing applications and providing hands-on support
  • The "Capital-as-a-Service" concept could automate funding decisions through data analytics and AI
  • Early exposure to technology can provide valuable opportunities regardless of financial circumstances
  • The internet allowed Garry to bypass age barriers and be taken seriously as a professional at 14
  • Cold-calling businesses from the Yellow Pages was an effective way to find clients in the early days of the internet
  • Garry's technical skills allowed him to help his family achieve financial stability at a young age
  • In 2001, Garry accurately predicted how social media would transform human interaction
  • Entrepreneurship can be a path to upward mobility - Garry went from a food-insecure childhood to helping his parents buy their first home

💰 Garry's First Million

Garry shares his journey to making his first million, which took much longer than might be expected:

  • Joined Palantir as employee #10 and designed the logo
  • Did grassroots marketing at Stanford, putting Palantir logos on pizza boxes saying "join the next Google"
  • Students would "give us dirty looks like how dare you"
  • Palantir shares eventually became valuable, but "did not seem like it was going to for a really long time"
  • His first million actually came from selling Twitter stock at IPO

The timeline of Garry's journey to financial success:

  • Started working in tech at age 14 (1995-1996)
  • Graduated college with $50,000 in credit card debt
  • In 2004, had "$34-40,000 credit card debt and maybe $50,000 in student loans"
  • This debt influenced his decision not to quit his job to join Palantir
  • Considered staying at Microsoft as a "lifer" (which he now says "would be sort of like a life of torture")
  • First real wealth came 18 years after he started working in tech

📱 The Posterous Story: Lessons in Startup Focus

Garry founded Posterous in 2008, a "dead simple blogs by email" platform:

  • Users could email content to posterous.com without logging in
  • The platform would automatically create a blog and website
  • Also functioned like an email list for sharing with family
  • Grew 10x year-over-year two years in a row

The Instagram disruption:

  • When Instagram launched, Posterous was one of the "little check marks" along with Tumblr, Foursquare, Twitter
  • Investor Chris Sacca emailed asking what they thought about Instagram
  • Garry's co-founder replied "it sucks"
  • Sacca responded: "I'm very disappointed in you guys"

"I think about that all the time now because when you're working on a startup, we didn't actually even totally understand why we were growing that fast."

In retrospect, Garry realized:

  • Posterous was growing because the iPhone was new and people were taking lots of photos
  • There were no apps that made it easy to upload
  • Instagram created a network with utility (filters) that was free
  • "We got run over by the eventual winner"

🎯 Playing Your Own Game

Garry shares critical startup advice about not letting others define your competition:

  • TechCrunch framed Posterous as "way easier to use than Tumblr"
  • This caused them to mistakenly focus on Tumblr as competition
  • "We weren't competing against Tumblr. We were competing against how people were getting photos off their phone."
  • "When you're not careful, you allow media or other people to frame your reality and then you just play the wrong game."
  • "Tumblr didn't even want to be Tumblr—that ended up having zero enterprise value."

The missed opportunity:

  • Had about a million dedicated users
  • Could have charged $5-10 monthly and been profitable with their 12-person team
  • Instead, they pivoted away from their core idea to "chase this idea that we could be the free social network"

Garry contrasts their approach with Weebly:

  • Weebly only raised a small amount from YC Demo Day
  • Never raised a Series A
  • Eventually sold to Square for $300-400 million
  • Weebly founders "made 100 times more money than me and my co-founder"
  • They succeeded by "being profitable, cash flowing, compounding, focusing on users, and playing their own game"

Garry recalls a pivotal meeting with Peter Fenton at Benchmark:

  • Fenton asked: "Are you a platform or are you a network?"
  • They answered "both" because "that's what founders who don't have strong opinions end up saying"
  • Benchmark passed on their Series A

The key lesson for founders:

  • It's not just "make something people want, raise Series A and B, and look like a successful startup"
  • It's "make something people want and that's the end in itself"
  • "If you do that, you're going to make money... and create real enterprise value for yourself"

🤔 Serious vs. Fun: Choosing What to Work On

Garry discusses the tension between working on "serious" products versus "fun" ones:

  • Palantir was a "very serious company" that "prevents terrorist attacks"
  • Posterous was "just a blogging platform" and could be seen as less serious
  • YC is now "a multi-billion dollar company" and more serious again

Garry's perspective:

  • "Be careful what frame you accept. It's all made up, but you get to make it up."
  • People said the same things about Facebook not being serious
  • Early Facebook employees "never accepted the frame that Facebook was not a serious and important thing"
  • Zuckerberg's narrative: "Once every few decades everything would change, media would totally change—and they were right."

📊 Distribution and Creating Value in Today's World

Garry shares insights on distribution challenges for businesses today:

  • "If you're running a business today, you kind of have to be a creator"
  • Otherwise, "you got to buy eyeballs somehow, and guess who's got the monopoly on eyeballs? Larry, Sergey, and Mark Zuckerberg."
  • "You got to pay the toll to go across the bridge"
  • The ad networks' second-price auction mechanism makes "all incremental attention so valuable"
  • These are "the most durable, powerful network effects businesses that cannot be disrupted"

On B2B vs. consumer businesses:

  • About 70-80% of YC companies are B2B
  • The most well-attended YC mini-conference is the sales mini-conference
  • They give "Founder's Sales" by Pete Kazanjy to every founder
  • Most people struggle with rejection: "Most people have never been rejected 95 out of 100 times"

The mindset shift needed:

  • "If your website conversion rate's 5%, you're doing phenomenal"
  • "You go out and knock on 100 doors and get 95 NOs, you feel like you're the biggest failure in the world"
  • "It's the same conversion. You should [feel like a winner] because you got five Enterprise contracts paying you $10,000 to $100,000 a year."

📚 References

People:

  • Peter Fenton - Benchmark investor who passed on Posterous's Series A
  • Mark Zuckerberg - Facebook founder, mentioned for his vision
  • Chris Sacca - Investor who questioned Posterous about Instagram
  • Pete Kazanjy - Author of "Founder's Sales"
  • David Rusenko and Dan Veltri - Weebly founders

Companies:

  • PayPal - Where Garry worked as employee #10
  • Posterous - Garry's blogging platform startup
  • Weebly - Contrasted with Posterous for their business approach
  • Microsoft - Where Garry considered being a "lifer"
  • Instagram - Disrupted Posterous's growth
  • Tumblr - Mistakenly viewed as Posterous's main competition
  • Twitter - Source of Garry's first million dollars
  • Facebook/Meta - Discussed for distribution and creator strategy
  • Palantir - Mentioned as a "serious" company
  • Y Combinator - Discussed throughout as Garry's current company

Concepts:

  • Distribution challenges - The difficulty of reaching customers without paying tech giants
  • Second-price auction - How ad networks extract maximum value from businesses
  • Playing your own game - Not letting others define your business or competition
  • Rejection in sales - The mindset needed to handle constant rejection

💎 Key Insights

  • Financial success in tech often takes much longer than people realize - Garry took 18 years from starting in tech to making his first million
  • Startups can grow rapidly without founders fully understanding why - understanding the true drivers of growth is critical
  • Letting others (media, investors) define your competition can lead you to "play the wrong game"
  • There's a crucial difference between building a startup that "looks successful" (raising rounds) versus creating real enterprise value
  • Distribution is the key challenge for most businesses today, with tech giants controlling access to customers
  • For B2B businesses, handling rejection is a critical skill - a 5% success rate in sales can be extremely profitable
  • Being a creator is increasingly important for business owners to avoid paying the "toll" to tech platforms
  • Sometimes the less "serious" business can create more value than the seemingly important one

🚀 Early Days at YC

Shaan asks Garry to share stories about the interesting characters he's met through YC, like Paul Graham, Sam Altman, and others in the network.

Garry describes his transition to YC after Posterous:

  • Joined as "designer in residence" after burning out at Posterous
  • Had a falling out with his co-founder who "wanted to become Google Groups"
  • Paul Graham gave him his "first shot as an investor and adviser to startups"

The early YC environment was humble and scrappy:

  • Not a campus but "a warehouse with some carpet"
  • Cheap furniture with "tables and benches so rickety that if you sat on one side and the other person stood up, you'd fall over"
  • When Garry said he was going to work at YC, friends in venture would say "Oh that's nice" like he was "going to volunteer at a high school camp"

The turning point for YC's reputation:

  • Dropbox had become a billion-dollar company
  • Airbnb was about to reach that milestone
  • Sarah Lacy had written a book called "One Year Lucky, Two Years Good"
  • 2011 was when people realized YC "isn't some fringe thing" but was "starting to turn out basically the most dominant startups"
  • YC was becoming "a very concentrated form of Silicon Valley"

🖨️ Paul Graham's Photocopier Story

Garry shares a revealing story about Paul Graham's aversion to corporate culture:

  • YC's one finance person needed a copy machine
  • She got a waist-height copier that "looked corporate" with little stickers on it
  • Paul Graham came in asking, "What is this? Why is this here?"
  • He saw it as a "totem of corporateness" and said, "I remember seeing these at Yahoo and I hated them"
  • Started scraping off the sticker with the maintenance company's phone number

This story exemplifies Paul Graham's character and philosophy:

  • Showed up to work in "shorts and Birkenstocks"
  • Wore khaki pants to Garry's wedding (causing Garry's sister-in-law to mistake him for a crasher)
  • Had a deep aversion to formality and corporate culture

"I sort of stay up at night thinking about how do I make sure that YC never feels corporate."

🎭 Fighting Formality and "Playing Business"

Garry extracts important lessons from Paul Graham's approach:

  • "There is an insidious nature to formality and corporateness"
  • "Whenever there is prestige and/or convention, you should be wary"
  • Formality often brings "weird soul-sucking things" that no one would choose by default
  • Leaders should "beware of your own formality and try to fight against it"
  • Try to be "super matter of fact" instead

The conversation shifts to how founders often fall into "playing business":

  • Getting business cards before getting customers
  • Implementing corporate practices like OKRs
  • The "lameness" of Silicon Valley corporate culture that even Garry admits falling victim to
  • The tension between what's useful versus what slows companies down
  • The challenge of knowing "what you should do versus what you have to do"

🍕 The Edge of Startups with a 2-Pizza Team

Garry makes an exciting prediction about small teams in the AI era:

  • "It's possible for people to do insane business now with like two-pizza teams"
  • People in the podcast community might build "hundred million to billion dollar a year businesses"
  • These businesses will be "totally empowered by large language models"
  • They "do not need more than 20 people working at them"

This represents a fundamental shift in business:

  • "This is literally the most exciting news that we're pretty sure is going to happen in the next few years"
  • "Corporate America is completely unprepared for this moment"
  • Large corporations "are just going to get run over by a thousand startups that are way more agile"
  • Smaller teams "aren't completely drowning in convention" and "can just do the right thing for the customer"
  • The cost basis for startups will "come down a ton"

Garry wonders about the economic implications:

  • Uncertain if this trend is "inflationary or deflationary"
  • In theory, prices should come down
  • Things should get "a lot more competitive"
  • Products and services should get "better, cheaper, faster"

👴 The Generational Divide in Adapting to AI

Garry highlights a generational gap in embracing AI technologies:

  • YC works with "22, 25, 28 year olds who were like the me from 15 years ago"
  • These young founders were "born on the internet" and "born with large language models"
  • In contrast, Garry's generation of C-level executives (he's 43) isn't prepared
  • "I don't think people are prepared or even aware of what's about to happen right now"
  • This represents "super super good news for anyone who's running a business who's super agile"

Specific opportunities Garry sees:

  • No longer needing to "call the business process automation call center"
  • No need to "hire the team in the Philippines anymore"
  • Direct advice to YC founders: target businesses spending "hundreds of thousands of dollars a year on a call center"
  • Replace these services with "large language models that have great evals and great workflow"
  • Predicts "many companies driving tens to hundreds of millions of dollars literally in the next two years"
  • "Hundreds of them, thousands of them are going to pop up right now"

📚 References

People:

  • Paul Graham - YC co-founder, focus of the photocopier story
  • Jessica Livingston - Mentioned as PG's partner in early YC work
  • Sarah Lacy - Author who wrote about YC's turning point

Companies:

  • Y Combinator - The startup accelerator discussed throughout
  • Dropbox - Mentioned as YC's first billion-dollar company
  • Airbnb - Mentioned as becoming a billion-dollar company around 2011
  • Google - Referenced for Google Groups
  • Yahoo - Where Paul Graham saw corporate culture he disliked

Concepts:

  • Two-pizza teams - Small teams where everyone can be fed with two pizzas (typically 5-8 people)
  • Corporate culture - The formality Paul Graham strongly rejected
  • Large language models (LLMs) - Key technology enabling small teams to compete with larger corporations
  • OKRs (Objectives and Key Results) - Mentioned as part of Silicon Valley corporate culture

💎 Key Insights

  • YC evolved from a humble "warehouse with carpet" to the most influential startup program in Silicon Valley
  • Paul Graham's aversion to corporate culture and formality shaped YC's ethos and continues to influence Garry's leadership
  • Founders often waste energy "playing business" instead of focusing on creating value for customers
  • AI and large language models are creating an unprecedented opportunity for small, agile teams to build massive businesses
  • There's a generational divide in embracing AI technologies, with younger founders naturally adapting while established business leaders struggle
  • The next few years will see thousands of AI-powered startups disrupting established industries by replacing outsourced services
  • Small teams have a distinct advantage in the AI era due to their agility and freedom from corporate conventions

🤖 Advice for Founders in AI

Garry shares practical advice for founders building AI companies:

Focus on tooling and testing:

  • "The tooling for this is important... there's going to be a lot around helping people build the stuff"
  • "Evals in particular - doing it test-driven is important"
  • The danger is making "demo-ware that you can use to raise money"
  • Many founders "raw dog your prompts" - writing code with prompts but no tests

A proven AI startup formula (what "80% of YC companies are doing"):

  1. Find businesses spending "hundreds of thousands of dollars a year on giant teams of people doing rote repeating knowledge work"
  2. Get access to their data and workflow
  3. Watch how they do their work
  4. Write test cases
  5. Handle hallucinations by breaking down prompts into smaller chunks

"The LLMs are capable of maybe like 120 IQ level work right now and if you're giving it too much in the context window and asking it to output too much, it's just like...do it in steps."

Concerns about future AI development:

  • The next generation of models from Anthropic, OpenAI, and Meta may be "one and then two orders of magnitude" more powerful
  • Dario Amodei's scaling laws paper predicts "AI labs are going to spend a billion and then 10 billion dollars on the next generations"
  • This creates uncertainty: "All the stuff that we're doing as founders...maybe the models will just do for themselves"

Long-term strategy for AI startups:

  • "My hope is that there's not enough agency in these things"
  • Founders who establish "brands and moats and evals right now" will benefit when "cost structure just comes down by like 10x"
  • The key is to capture market share from software incumbents now
  • Traditional moats will apply: better data access, smarter systems, high switching costs, and superior sales teams

"If you do prompts and evals, you are pulling forward the future by a few years. You're trying to grab as much land as you possibly can right now...and then from there, hopefully you can hold on and build the next Microsoft or the next Salesforce."

👨‍💻 Sam Altman's Foresight and OpenAI's Success

The conversation shifts to Sam Altman and his vision for AI:

Garry's initial skepticism:

  • When Sam was YC president, he'd return from meetings saying "this is what Elon was talking about, this is what Larry was talking about"
  • They were discussing AI and "sci-fi scenarios"
  • Garry admits: "I'm like, man, I saw Terminator 2 too, but that was a movie"
  • "I wish I was smart enough to be actually totally a believer. I'm a believer now."

What Sam got right:

  • "Jumping on this thing that the smartest people in the world were already talking about eight, nine years ago"
  • Building it by investing money and bringing together talent
  • Accomplishing what giant tech companies couldn't

"It was like a semi-miracle. You could ask why didn't Meta do this before? Why didn't Google do this before? Why didn't Microsoft Research do this before? All of those people had virtually limitless access to resources."

🏢 Why Big Companies Failed at AI

Garry explains why established tech companies lagged behind OpenAI:

  • Big tech companies are "like big daycares for the most technical smart people in the world"
  • "Here's do your laundry at work... let's totally infantilize the smartest people in the world"
  • At Google, researchers needed to navigate bureaucracy and politics
  • Limited compute resources had to be shared among hundreds of researchers
  • Papers would have "30 different authors" with "strange things that seem like it was a little bit tacked on"
  • This was the only way to "get the compute resources to actually pull off a training run"

The fundamental issue:

  • "Human progress is more or less impeded by the bureaucracy and lack of governance and lack of agency that large organizations impose on people"
  • "It was easier for them to invent/discover Transformers and this large language breakthrough than it was for them to navigate the bureaucracy to actually create a product"

Even OpenAI faced this challenge:

  • Originally meant to be "a research lab, not a product company"
  • Took "herculean efforts by product people inside OpenAI" to release ChatGPT
  • Which became "the greatest consumer launch maybe in the history of consumer launches"

💼 The Future of Knowledge Work

Garry explains the massive opportunity to transform routine knowledge work:

  • "A few people who are really smart can sit in a room and make a thing that literally does what humans do all day"
  • The best tasks to automate are "the knowledge worker equivalent of hand-looming a carpet"
  • Examples: "Look at an email box, see if someone paid their bill, reconcile that against a ledger in QuickBooks"
  • "Tens of millions of people on the planet - that's their 9-to-5"
  • "That is not a good use of a very smart human being"

The transformation ahead:

  • "20-person software engineering focused startups" will turn "billions of dollars in payroll into billions of dollars in software revenue"
  • "Hopefully those people go on to do much smarter and much more interesting jobs than passing butter all day"

🥄 The Spoon-Bending Story

Garry shares a memorable story from Burning Man that serves as a powerful metaphor for entrepreneurship:

  • Attended Burning Man, which he calls "my favorite place to take a break from consensus reality and realize that it's all made up but you get to make it up"
  • Wandered into a "spoon-bending party" where someone claimed to teach people how to bend spoons with their minds
  • They passed out spoons and instructed people to bend them mentally
  • Then said "sometimes you need to use your hands and warm up the spoon"

The reveal:

  • Garry realized you were supposed to actually bend the spoon with your hands while pretending it was mental
  • By the end, half the room had bent spoons while the other half was amazed
  • Those who didn't bend their spoons asked "How did you do that? That's absolutely incredible"
  • Garry: "Guys, it's a bit! First know that you can bend the spoon with your mind, but then you bend it with your hands!"

The metaphor for entrepreneurship:

  • "It's a little bit of an allegory for bias to act and what you're supposed to do in real life"
  • "They say you can change the world with your very ideas, but that alone is not enough"
  • "You actually have to go with your hands and go talk to users and sit and build a thing"
  • "The wildest thing is more than half of the room could not do it"

"If you are the person who's able to bend the spoon with your mind - guess what, you also used your hands. You got to do that."

📚 References

People:

  • Sam Altman - Former YC president, OpenAI CEO
  • Elon Musk - Mentioned as discussing AI with Sam
  • Larry Page - Mentioned as discussing AI with Sam
  • Dario Amodei - Referenced for scaling laws paper

Companies:

  • OpenAI - Discussed throughout regarding AI development and ChatGPT
  • Anthropic - Mentioned as developing next-gen AI models
  • Meta - Mentioned as developing next-gen AI models
  • Google - Discussed for bureaucratic approach to AI research
  • Microsoft - Mentioned regarding research limitations
  • Salesforce - Referenced as comparison for future AI companies

Concepts:

  • Evals - Testing frameworks for AI systems
  • Prompt engineering - Crafting instructions for AI models
  • Scaling laws - Mathematical relationships between model size and performance
  • Transformers - The AI architecture behind modern language models
  • Moats - Competitive advantages for businesses

Events:

  • Burning Man - Setting for the spoon-bending story

💎 Key Insights

  • AI startups should focus on testing and validation rather than just creating demos
  • The most successful AI strategy today is targeting businesses spending heavily on routine knowledge work
  • Current AI models are comparable to "120 IQ level work" but require breaking complex tasks into manageable steps
  • Future AI models may be orders of magnitude more powerful, creating uncertainty about current business models
  • Big tech companies failed at leading AI development due to bureaucracy and organizational limitations
  • The greatest opportunity in AI is automating routine knowledge work currently done by millions of people
  • Success in both entrepreneurship and "spoon bending" requires not just ideas and vision but practical execution
  • The window of opportunity is now: capture market share before next-generation models potentially change the game