Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

a16za16z

Unlocking Creativity with Prompt Engineering

The growth of AI is changing modern life—including the job market. In just one example, there is a highly creative role emerging alongside AI: the prompt engineer. In this episode we explore the emerging importance of prompting with Guy Parsons, the early learnings of how to do it effectively, and where this field might be going. Will the prompt engineer be more like the highly sought after DevOps engineer, or a proficiency like Excel that you find on every resume? Listen in to hear Guy’s take. Interested in the prompt competition? Email us at podpitches@a16z.com. Topics Covered: 0:00 - Introduction 01:41 - DALL-E 2 Prompt Book 05:33 - Parallel skills 06:58 - 80/20 prompting 10:22 - New ways of prompting 13:00 - Pulling the AI slot machine 18:13 - Comparing models 21:03 - Requested features 27:44 - Learning with AI 28:44 - Practical use cases 32:08 - A top 1% prompt engineer 37:28 - The most popular images Resources: * DALL-E 2 Prompt Book: https://dallery.gallery/the-dalle-2-prompt-book/ * Find Guy on Twitter: https://twitter.com/GuyP * Image combination: https://twitter.com/GuyP/status/1612880405207580672 * Guy’s amorphous prompt experiment: https://twitter.com/GuyP/status/1608475973300948993 * Guy’s space duck: https://twitter.com/GuyP/status/1601342688225525761 * Prompt base: https://promptbase.com/ * Lexica: https://lexica.art/ Stay Updated: * Find us on Twitter: https://twitter.com/a16z * Find us on LinkedIn: https://www.linkedin.com/company/a16z * Subscribe on your favorite podcast app: https://a16z.simplecast.com/ * Follow our host: https://twitter.com/stephsmithio Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. For more details please see a16z.com/disclosures.

Guy ParsonsguestSteph Smithhost
Mar 9, 202339mWatch on YouTube ↗

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

At a glance

WHAT IT’S REALLY ABOUT

Guy Parsons on Prompt Engineering and the Future of Text-to-Image AI

  1. Guy Parsons explains that he wrote his DALL-E 2 Prompt Book by collecting examples and terms people shared on social media, because a text box with no controls leaves many users unsure what words to type.
  2. He advises describing an image as if it already exists, like a caption in a photo gallery or clip-art library, which also explains why the tools struggle with step-by-step spatial instructions.
  3. The conversation covers how the tools have evolved, including image-based prompting, selfie-generating apps, and Midjourney handling composition better than DALL-E, while randomness, negative prompts and glitches still limit control.
  4. Parsons and Smith envision future interfaces that go beyond the text box, such as conversational or multi-option exploration and locking in a consistent style, to express looks that have no names.
  5. On the future of the skill, Parsons says prompt engineering likely won't be a universal necessity but will have dedicated experts and hidden prompt layers, while Smith sees a bimodal outcome.

IDEAS WORTH REMEMBERING

5 ideas

Prompt as if the image already exists

Parsons suggests imitating captions found on photo galleries or clip-art libraries, since the models learned from such descriptions. This also explains why they handle general descriptions better than detailed layout instructions.

Randomness makes skill hard to judge

Because each generation starts from a different cloud of noise, Parsons notes it's unclear whether a good result came from cleverness or luck. Seeing others' work and prompts gives evidence that a result is achievable.

Models share principles but differ in nuance

Parsons says skills transfer between tools, but Midjourney does more heavy lifting than DALL-E, and each model's training data and fine-tuning produce different outputs for very specific effects.

Image prompting opens a new frontier

Prompting with images, as in selfie apps or generating variations from core images, is unpredictable and hard to control. It could let users multiply a consistent visual base like brand colors.

The text box is a limiting interface

Parsons compares AI to clients who can't explain what they dislike, and suggests conversational or multi-option interfaces could help express styles that have no names.

WORDS WORTH SAVING

5 quotes

You've just gotta find the words that summon it forth as if you're kind of navigating like an infinite Pinterest of things that haven't quite existed until you manifested them.

— Guy Parsons

If you can create ways of unleashing the inexplicable, the undefinable, which is what at the end of the day, that's the exciting thing about visual art, is to express things or moods or things that you can't quite put into words.

— Guy Parsons

Much as, like, green screen, right? Like, when green screen is used in films, you shouldn't be like, "That is an amazing use of green screen."

— Guy Parsons

The best way to explain how they work is to always like describe something as if it already exists.

— Guy Parsons

Designers, yeah, when they do work for clients, like, it's one of their pet peeves because clients are like, they don't like it, but they can't explain why or what they want different.

— Guy Parsons

DALL-E 2 Prompt Book originsDescribing images like captionsImage-to-image prompting and selfie appsRandomness and black-box frustrationsDifferences between Midjourney, DALL-E and Stable DiffusionGoing beyond the text boxFuture of prompt engineering as a skill

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.