Skip to content
The Twenty Minute VCThe Twenty Minute VC

Douwe Kiela: Why Data Size Matters More Than Model Size; Why Open Source Isn't Going to Win | E1032

Douwe Kiela is the CEO of Contextual AI, building the contextual language model to power the future of businesses. Last month Contextual closed a $20M funding round including Bain Capital, Sarah Guo, Elad Gil and 20VC. He is also an Adjunct Professor in Symbolic Systems at Stanford University. Previously, he was the Head of Research at Hugging Face, and before that a Research Scientist at Facebook AI Research. -------------------------------------------- In Today’s Episode with Douwe Kiela We Discuss: 1. Founding a Foundational Model Company in 2023: How did Douwe make his way into the world of AI and ML over a decade ago? What are some of his biggest lessons from his time working with Yann LeCun and Meta? How does Douwe’s background in philosophy help him in AI today? 2. Foundational Model Providers: Challenges and Alternatives: What are the biggest problems with the existing foundational data models? Will there be one to rule them all? How does the landscape play out? Why does Douwe believe OpenAI’s data acquisition strategy has been the best? 3. Data Models: Size and Structure: Why does Douwe believe it is naive to think the open approach will beat the closed approach? What are the biggest downsides to the open approach? Does the size of data model matter today? What matters more? How important is access to proprietary data? Are VCs naive to turn down founders due to a lack of access to proprietary data? 4. Regulation and the World Around Us: How does Douwe expect the regulatory landscape to play out around AI? Why is Europe the worst when it comes to regulation? Will this be different this time? How does Douwe analyse Elon’s petition to pause the development of AI for 6 months? Do founders building AI companies have to be in the valley? ---------------------------------------- #DouweKiela #ContextualAI #HarryStebbings #artificialintelligence

Douwe KielaguestHarry Stebbingshost
Jun 30, 202353mWatch on YouTube ↗

Episode Details

EPISODE INFO

Released
June 30, 2023
Duration
53m
Channel
The Twenty Minute VC
Watch on YouTube
▶ Open ↗

EPISODE DESCRIPTION

Douwe Kiela is the CEO of Contextual AI, building the contextual language model to power the future of businesses. Last month Contextual closed a $20M funding round including Bain Capital, Sarah Guo, Elad Gil and 20VC. He is also an Adjunct Professor in Symbolic Systems at Stanford University. Previously, he was the Head of Research at Hugging Face, and before that a Research Scientist at Facebook AI Research. -------------------------------------------- In Today’s Episode with Douwe Kiela We Discuss:

1. Founding a Foundational Model Company in 2023: How did Douwe make his way into the world of AI and ML over a decade ago? What are some of his biggest lessons from his time working with Yann LeCun and Meta? How does Douwe’s background in philosophy help him in AI today?

1. Foundational Model Providers: Challenges and Alternatives: What are the biggest problems with the existing foundational data models? Will there be one to rule them all? How does the landscape play out? Why does Douwe believe OpenAI’s data acquisition strategy has been the best?

1. Data Models: Size and Structure: Why does Douwe believe it is naive to think the open approach will beat the closed approach? What are the biggest downsides to the open approach? Does the size of data model matter today? What matters more? How important is access to proprietary data? Are VCs naive to turn down founders due to a lack of access to proprietary data?

1. Regulation and the World Around Us: How does Douwe expect the regulatory landscape to play out around AI? Why is Europe the worst when it comes to regulation? Will this be different this time? How does Douwe analyse Elon’s petition to pause the development of AI for 6 months? Do founders building AI companies have to be in the valley? ---------------------------------------- #DouweKiela #ContextualAI #HarryStebbings #artificialintelligence

SPEAKERS

  • Douwe Kiela

    guest
  • Harry Stebbings

    host

EPISODE SUMMARY

In this episode of The Twenty Minute VC, featuring Douwe Kiela and Harry Stebbings, Douwe Kiela: Why Data Size Matters More Than Model Size; Why Open Source Isn't Going to Win | E1032 explores data Over Parameters: Rethinking AI Models, Moats, Risk and Regulation Douwe Kiela traces his path through Meta FAIR, Hugging Face, and into founding Contextual, using that journey to frame how modern language models are built, evaluated, and deployed.

RELATED EPISODES

Town vs Instinct vs GrokBot | Why the AI Assistant Market Is Not a Bubble

Town vs Instinct vs GrokBot | Why the AI Assistant Market Is Not a Bubble

How to Build Your Own Data Center & Why Every Startup Should Do It

How to Build Your Own Data Center & Why Every Startup Should Do It

NVIDIA Crushes Quarter | OpenAI Cuts Off Cursor | Instinct Hits $2.5B Valuation

NVIDIA Crushes Quarter | OpenAI Cuts Off Cursor | Instinct Hits $2.5B Valuation

Anthropic's $30T Assumption & OpenAI Confirms IPO | Why Customer Service & Robotics are Overinflated

Anthropic's $30T Assumption & OpenAI Confirms IPO | Why Customer Service & Robotics are Overinflated

Stripe's $8B OpenRouter Bet | Anthropic's First Profit & The Math Behind Reaching $600B in Revenue?

Stripe's $8B OpenRouter Bet | Anthropic's First Profit & The Math Behind Reaching $600B in Revenue?

Inside Sequoia's Investment Committee | How the SpaceX & Citadel Deals Went Down | Julien Bek

Inside Sequoia's Investment Committee | How the SpaceX & Citadel Deals Went Down | Julien Bek

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.