Aakash GuptaHow to Build an AI Chief of Staff with Mikhail Shcheglov, CPO at OLX Classifieds
At a glance
WHAT IT’S REALLY ABOUT
Building an AI chief of staff through knowledge graphs and agents
- OLX built a company knowledge graph over five months and tracks “product context coverage” (e.g., 54%) as a KPI for how well the AI understands the business, customers, and market to safely increase autonomy.
- The “agentic CPO” shifts from process/scaffolding ownership to owning an AI operating system—architecture, rituals, rules, access control, and continuous iteration—so AI can handle repetitive work and elevate PM leverage.
- A Slack-based agent handles status reporting, stakeholder feature-intake triage, and personal exec assistance (email/calendar digests and scheduling) using a large library of imperatives to reduce hallucinations and “fake helpful” answers.
- The underlying stack blends OpenClaw (scaffolding/tools) with Hermes (auto-generated skills), uses three persistent memory layers (knowledge graph, vector DB, raw transcripts), and applies hybrid retrieval to avoid context overload.
- Agents extend into high-value workflows like board-deck critique (“board skill”), design system generation/maintenance, backlog abstraction across spreadsheets, and recruiting automation covering ~70–75% of the funnel.
IDEAS WORTH REMEMBERING
5 ideasTreat knowledge retention as a core AI-native goal, not a byproduct.
Shcheglov frames AI-native teams as a way to prevent knowledge leakage when experts leave by centralizing business, product, and customer context into a persistent, queryable system.
Measure AI usefulness with a context coverage KPI tied to delegation potential.
OLX prompts the system to estimate its knowledge across industry, business model/PNL drivers, and customer segments, using the resulting percentage as a directional indicator for how autonomously the agent can operate.
The CPO’s new leverage is owning the agentic scaffolding and rituals.
Instead of primarily enforcing planning cadences and review ceremonies, the agentic CPO builds the environment where AI collaborates with teams, makes bounded decisions, and continuously improves through fast feedback-to-deploy cycles.
Automate PM “ritual work” first to double down on discovery.
He estimates ~50% of PM time historically goes to reporting and repetitive coordination; delegating that to agents can let one PM cover the output of two while focusing human time on customer discovery and judgment.
Raw transcripts can outperform summaries for retrieval quality.
They found summarization degraded recall (20–25% worse) by removing nuance and forcing templates, so they store full transcripts and rely on retrieval to pull only relevant slices.
WORDS WORTH SAVING
5 quotesthe core goal of having AI native teams is to be able to automate as much knowledge as we can.
— Mikhail Shcheglov
it understands our industry, uh, like classifieds, our market, our business, our business model specifically, the top line, the bottom line, the drivers behind it, our customers and the value drivers for them at the level of 54%, which already means that it can operate as a capable, I would say, junior to mid product manager and even make backlog level decisions.
— Mikhail Shcheglov
I don't read my email anymore. Like an agent does it for me and pings me in case if it's, uh, if it's urgent. I don't manage my calendar anymore.
— Mikhail Shcheglov
summarization actually hurts a retrieval.
— Mikhail Shcheglov
I have good news for you. I think, uh, not only product management is going to exist, I think it's gonna thrive.
— Mikhail Shcheglov
High quality AI-generated summary created from speaker-labeled transcript.