Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

a16za16z

Can We Detect a Deepfake?

Deepfakes. A portmanteau of deep learning and fake, that started making their way into public consciousness in 2018. The rapidly evolving technology is now fully in the zeitgeist, impacting industries ranging from politics to commerce, and of course, social media. At the rate that they’re appearing, deep fakes might sound like an impossible problem to tackle. But it turns out that despite the lower barrier to entry, advancements in detection tools are keeping pace. In today’s video we’ll discuss the technology, policy, and economy behind deepfakes with someone who has been thinking about voice security long before it became popular: Vijay Balasubramaniyan, cofounder and CEO of Pindrop. Topics Covered: 00:00 - The Rise of Deepfakes 00:49 - The Evolution of Fake Media 02:23 - The Technology Behind Deepfakes 07:34 - AI and Deepfakes in Elections 09:50 - Statistics in Commerce and Banking Deepfakes 11:24 - Detection Challenges: Can We Spot a Deepfake? 13:09 - Watermarking and Cryptography 15:40 - The Economics of Deepfake Creation and Detection 19:15 - What Can Spam Teach Us About Deepfakes? 21:11 - What Are the Defenses? 24:30 - Policy, Platforms, and Accountability 28:54 - Preparing for a Deepfake-Proof Future Resources: Find Vijay on Twitter: https://x.com/vijay_voice Find Martin on Twitter: https://x.com/martin_casado Let us know what you think: https://ratethispodcast.com/a16z Find a16z on Twitter: https://twitter.com/a16z Find a16z on LinkedIn: https://www.linkedin.com/company/a16z Subscribe on your favorite podcast app: https://a16z.simplecast.com/ Follow our host: https://twitter.com/stephsmithio Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Vijay BalasubramaniyanguestMartin Casadohost
Oct 30, 202430mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

At a glance

WHAT IT’S REALLY ABOUT

Deepfakes Are Surging, But Detection Remains Cheaper and Feasible

  1. Vijay Balasubramaniyan says deepfakes have surged, with a 1400% increase in the first six months of this year versus all of last year, as voice-cloning tools grew from 120 to 350 and cloning needs only seconds of audio.
  2. He describes real cases such as the January New Hampshire Biden robocall, bank customers facing a deepfake per day, and news organizations finding 90% of some conflict footage fake.
  3. He argues deepfakes are detectable, citing 99% detection with a 1% false positive rate, because generators leave artifacts and must balance sounding human against evading detectors.
  4. He says detection costs about one-hundredth of generation, and that watermarking is limited because attackers won't comply and a watermark was largely stripped in the Biden call.
  5. He recommends policy that is hard on threat actors and flexible for creators, modeled on CAN-SPAM and Know Your Customer rules, with platforms held accountable for labeling real versus AI content.

IDEAS WORTH REMEMBERING

5 ideas

Generative AI changed the scale and ease of deepfakes, not the basic scam

Scams like the Japanese 'help me grandma' fraud predate AI, but cloning now needs about 3 to 15 seconds of audio, and fraudsters pair voice tools with LLMs that can invent convincing stories.

Deepfake volume is rising sharply in commerce

Vijay says banks went from about one deepfake a month per customer in 2023 to one per customer per day this year, with some big banks seeing one every three hours.

Deepfakes are detectable because AI can inspect far more detail than human ears

Audio has thousands of samples per second, and generators make spectral and time-domain mistakes that a model can catch even when the voice sounds right to people.

Attackers face conflicting objectives

A generator must sound like the target and also evade detection; adding noise to hide artifacts makes speech unintelligible, as in the LeBron James fake, so the goals diverge.

Detection is much cheaper than generation

Vijay says his detection model is about one-hundredth the cost of generation, so attackers would need roughly two orders of magnitude more resources, and they would have to re-architect whole pipelines to evade it.

WORDS WORTH SAVING

5 quotes

There has been a 1400% increase in the amount of deepfakes we've seen this year in the first six months compared to all of last year.

— Vijay Balasubramaniyan

Like, in LLMs, hallucination is a problem, so the fact that you're making shit up is a bad idea. But if you have to make shit up to convince someone- The LLM is created perfect.

— Vijay Balasubramaniyan

Your human ear Can't look at anomalies 8,000 times a second. If it did, you'd go mad, right?

— Vijay Balasubramaniyan

I think the, the simple one-liner answer is they should make it really difficult for threat actors and really flexible for creators, right?

— Vijay Balasubramaniyan

So to detect it is two orders of magnitude cheaper than creation.

— Martin Casado

Generative AI voice cloningCheap fakes versus deepfakesElection and banking fraudDetection accuracy and fake printsWatermarking limitationsEconomics of detection versus generationSpam analogy and policy

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.