Skip to content

By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.

Aakash GuptaAakash Gupta

AI Agents for PMs in 69 Minutes — Masterclass with IBM VP

Armand Ruiz, VP of AI Platform at IBM, reveals why most enterprise AI implementations fail and what Fortune 500 companies are actually building that works.

Aakash GuptahostArmand Ruizguest
Sep 5, 20251h 9mWatch on YouTube

Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.

At a glance

WHAT IT’S REALLY ABOUT

AI agents, RAG, open source, and the PM shift explained

  1. AI agents are positioned as the next leap beyond chatbots because they combine reasoning with planning, tool-taking actions, and reflection to automate end-to-end work.
  2. Building agents increasingly splits into two tracks: code-first frameworks (e.g., LangGraph, CrewAI, LlamaIndex, AutoGen) for control and low/no-code builders (e.g., Lindy, n8n, LangFlow, Flowise) for accessibility.
  3. RAG remains a dominant enterprise technique for injecting fresh, company-specific context into LLM workflows, but reliability requires serious data engineering and evaluation at multiple steps—not just checking the final answer.
  4. Managing “10–20 agents per employee” introduces a new orchestration skill: humans become accountable reviewers of agent outputs, with governance, cost controls, and safe experimentation as key enterprise constraints.
  5. AI changes product management by compressing the PM lifecycle (research → prioritization → PRD → prototype → monitoring) and enabling broader PM coverage, while still requiring customer-first problem investigation to avoid feature-factory behavior.

IDEAS WORTH REMEMBERING

5 ideas

Agents matter because they close the loop from “answering” to “doing.”

Ruiz frames agents as the “wall of automation”: not just generating text, but decomposing tasks, executing actions in real systems (email/CRM/Workday), and improving through reflection over time.

The simplest useful mental model for agents is Think → Plan → Act → Reflect.

Thinking leverages LLM reasoning; planning breaks work into subtasks; action is enabled by tool access/protocols (he cites MCP); reflection uses feedback/history to iteratively improve future runs.

Pick your agent tooling based on required control, not hype.

Low/no-code builders accelerate experimentation for non-technical users, while code frameworks (LangGraph/CrewAI/etc.) remain necessary for complex, production-grade agentic systems needing deeper flexibility.

RAG is primarily for fresh context, not “making the model smarter.”

He distinguishes RAG (connecting to databases/knowledge bases for up-to-date info) from fine-tuning (better for behavior/style/specialization, not continuously changing enterprise knowledge).

Most RAG failures are evaluation and data-engineering failures, not “LLM failures.”

Enterprises can’t tolerate “70% accuracy,” so vanilla templates break; teams need systematic eval practices and better pipelines (embeddings, chunking, retrieval, filtering, ranking) to reach business-acceptable reliability.

WORDS WORTH SAVING

5 quotes

Agents… deliver the wall of automation that is gonna unlock everyone… to generate way more output.

— Armand Ruiz

Four simple steps. The first one is thinking… planning… action… reflection.

— Armand Ruiz

70% accuracy is not acceptable.

— Armand Ruiz

Evals in agentic workflows should be almost… at every single step if you're really serious about developing something… a critical system.

— Armand Ruiz

If you didn’t write the most beautiful detailed PRD, still a lot of information is lost in translation… nothing speaks better than just a working prototype.

— Armand Ruiz

Read the available transcript
Definition of AI agents vs chatbotsFour-step agent loop: think, plan, act, reflectAgent development: coding frameworks vs low/no-code toolsRAG vs fine-tuning and enterprise context injectionVision RAG for PDFs, charts, tables, multimodal extractionRAG accuracy, data engineering, and evals throughout workflowsMulti-agent orchestration and human-in-the-loop accountabilityHow AI reshapes PM ratios, workflows, and prototyping cultureOpen source AI in enterprise: deploy-anywhere controlIBM strategy: hybrid deployment, Granite models, governanceAI regulation and enterprise compliance inventoryAI talent wars as capital allocationCareer acceleration: prototypes, customer obsession, networkingLinkedIn growth systems and diminishing AI-content advantage

SPEAKERS

  • Aakash Gupta

    host

    Product leader and content creator who hosts the Aakash Gupta channel/podcast on product management and AI.

  • Armand Ruiz

    guest

    VP of AI Platform at IBM focused on enterprise AI platforms and agentic/LLM product strategy.

High quality AI-generated summary created from speaker-labeled transcript.

Get more out of YouTube videos.

Read along on your phone, search it beside the video, or ask your favorite AI app what was said.