Masterclass: Interview Homework for PMs

1. 0:00 – 1:25

   Intro

   1. SMSumant Malhotra0:00

      This deck back in '23, it actually got through, and it was a top company. But today, this would probably not even survive the screening round. The push is towards making the candidate think rather than just providing AI slop.

   2. AGAakash Gupta0:12

      You need to demonstrate your unique experience and expertise, not how well you can prompt AI.

   3. SMSumant Malhotra0:18

      For builder PM roles, this is the most commonly sought-after skill. This is what we will see the most even in the coming two years. It worked really well because of the systems thinking, audit trails, governance, phase rollout. Especially enterprise PMs, we live within these constraints almost all the time.

   4. AGAakash Gupta0:35

      It sounds like overriding lesson from both of these decks is quality of insight matters more than formatting.

   5. SMSumant Malhotra0:41

      Most candidates land just 80% of the way. That 20% is, uh, the evals and the economics behind it, and that's not something any LLM can help you do. This is something that either you have or you don't.

   6. AGAakash Gupta0:57

      Before we get into today's show, please take a second to check that you're subscribed on YouTube and following on Apple and Spotify podcasts. If you want access to all of my favorite AI tools, I've gotten them to give you an entire year of their paid plans. Check out bundle.aakashg.com for an entire year of Bolt.new, Airtable, Speechify, Descript, Magic Patterns, Linear, Dovetail, Arise, and Mobbin. And now into today's show.

2. 1:25 – 3:35

   Why PMs should care about interview homework

   1. AGAakash Gupta1:25

      Sumant, why should PMs even care about interview homework?

   2. SMSumant Malhotra1:28

      Uh, first of all, thanks for inviting me on this podcast, Aakash. Uh, really looking forward to our conversation in this one. Uh, let me answer your question. Uh, in the past and even in the current times, companies, uh, they want to assess candidates, but because there's an influx of way too many, [chuckles] uh, there is, of course, a shortfall of, uh, hands on deck to assess all of them. Uh, pre-interview assignments and homework assignments or take-home assignments, they kind of, uh, give companies an opportunity to put the candidate to work before they actually assess their qualities and skills in an interview, right? Uh, these assignments, they allow a company to see whether the candidate possesses the right skill set in terms of, uh, technical capability, uh, problem-solving, uh, even presentation and, uh, keeping an eye out for typical pitfalls, right? Stuff that, uh, most companies would, uh, have to train people upon, they can test all of that right here within these take-home assignments. Now, the new thing that has come up, especially in today's scenario, is because AI has made it just way too easy for people to go ahead and conjure stuff up, uh, companies are kind of, uh, tightening the noose around what kind of submissions are asked for, and their push is towards, uh, making the candidate think rather than just, uh, providing any sort of AI slop. So for this new age, uh, the candidates have to become a lot, lot, lot more smarter. And, uh, personally, if you ask me, uh, the ones that I have coached, I've always, uh, asked them this question, that if, uh, I give the same question to your younger cousin, uh, will they be able to prepare the same kind of slides that you have prepared, or would you have done a better job? And if the answer is even 50% yes, then I tell them to go back and prepare again.

   3. AGAakash Gupta3:25

      I love that. You need to demonstrate your unique experience and expertise that you've developed in your years as a PM or whatever background you have that qualifies you to be a PM,

3. 3:35 – 8:02

   Which companies give PM take-homes, and which don't

   1. AGAakash Gupta3:35

      not how well you can prompt AI. So who actually asks interview homework and who doesn't?

   2. SMSumant Malhotra3:42

      Uh, that's actually a great question. Uh, many companies like OpenAI, Anthropic, even Razorpay, CrowdStrike, Retool, et cetera, these companies which, uh, have, uh, you know, maybe a smaller pool of people, lesser hands on deck, uh, to be able to take out hundreds of interviews. Also, companies, uh, which have, uh, specific processes and use cases for which, uh, they want AI PMs to come in and demonstrate their abilities on using AI products, they are usually the first ones to push out take-home assignments. Uh, larger companies, uh, established companies like Google, Meta, and other s- uh, you know, FAANG companies more often than not who anyway want to establish themselves as at the frontier of best hiring practices, uh, they usually don't do this. At least for the, you know, higher-ups, they never really give take-home assignments. There is an exception. Uh, I've mentioned that as well, that their early career programs, uh, they might have this round for some cases, right? But, uh, usually those companies you don't really expect take-home assignments.

   3. AGAakash Gupta4:49

      So is it fair to say just based on the companies you have listed here that-

   4. SMSumant Malhotra4:54

      Mm-hmm

   5. AGAakash Gupta4:54

      ... sort of AI companies or more tech-native companies are more likely to give out homework?

   6. SMSumant Malhotra5:00

      You can say that. A lot of, uh, AI-native companies, they do want to assess, uh, the real AI skills of candidate because, uh, it has happened. A lot of people that were product managers earlier, they have become AI-enabled product managers, but they are still writing up AI PMs. So AI-native companies, they do want to Kind of differentiate between that. And that's why a lot of them, they do like to give out case studies specifically to discern whether the person has real functional knowledge about, uh, building AI products or not.

   7. AGAakash Gupta5:34

      Okay. So where does this show up? Like, is this typically in the middle of the process, the final round? Is this before you even interview? What is the most common setup?

   8. SMSumant Malhotra5:43

      Sure. Uh, it actually goes throughout the process. So there's of course the pre-interview screening. This is one of the most common steps. Uh, you can assume that, uh, a lot of companies, they push for this because it allows them to filter anyone, you know, before they actually spend time, uh, iterating through that candidate, having multiple discussions internally, and then bring that candidate itself. Uh, they, they just don't prefer that. They would rather give them a pre-interview screening. If they qualify for that, only then they are brought in for an interview. It can, however, also be taken forward. For example, there can be a mid-loop deep dive as well, wherein, uh, there would be some maybe third or fourth round of interview wherein a technical or perhaps a behavioral round is converted into a deep dive round wherein they will ask questions about why did you choose this particular product only? What made you prioritize this feature? Uh, which metrics are you suggesting and why, et cetera. So that can happen. It can also be, and this is not unheard of, the final round presentation where, uh, the depth of the candidate and, uh, their problem-solving skills are tested live in front of a panel based on the case study that they have submitted.

   9. AGAakash Gupta7:02

      This one in particular feels, like, very common even for senior roles, right? So I guess would it be-- At least what I've experienced is that juniors, they tend to get it sometimes even early, like first step. Like, uh, there's, uh, some apr- associate product builder programs, associate product manager programs where it'll even be pre-interview screen. And then I find sometimes for executives, like when I was a VP of product-

   10. SMSumant Malhotra7:27

       Mm-hmm

   11. AGAakash Gupta7:27

       ... and I interviewed for a couple of VP of product roles, my final round would be like a presentation to the CEO and CPO. Is that what you've seen? Is that fair to characterize broadly, or is that just my experience?

   12. SMSumant Malhotra7:39

       No, that's actually absolutely fair to characterize that way. It is, like I said, not unheard of that even senior folks are brought in front of a panel, and they're asked about the most strategic aspects of their decision-making. Why exactly are you choosing to go with this particular setup? Uh, what is the AI economics behind this decision, et cetera. Now, those are questions you do expect from a VP,

4. 8:02 – 9:42

   The 5 types of PM homework

   1. SMSumant Malhotra8:02

      right?

   2. AGAakash Gupta8:02

      Love it. So I think we both have experienced a similar thing in coaching people, so I think it's fair to say that's the universe out there.

   3. SMSumant Malhotra8:10

      Yeah.

   4. AGAakash Gupta8:10

      So what types of homework do people get if we had to put it into broad buckets?

   5. SMSumant Malhotra8:14

      Sure thing. So, uh, I've categorized the five types, and these are more prominent ones. I'm sure there would be some specific to analytics, something specific to just building prototypes and all. But, uh, you know, the ones that I'm broadly categorizing, uh, the first one has got to be PRD. I mean, product roles in AI, uh, you've got to ask them to generate a PRD for this vague and ambiguous problem statement. Yes. Uh, typically recruiters are looking for the candidate's composure. They are looking for whether the candidate asks questions back, states the assumptions properly. The same old standard practices that, uh, regular PMs also have followed, uh, just that this time the assumptions will be a lot more around AI. Uh, same goes for strategy and compete related, uh, questions. It can also be competitive benchmarking and, uh, based on that, uh, suggestions of, uh, what to build, what to improve, what to integrate, or maybe what to buy. Uh, there can be roadmap and prioritization related, uh, cases. There can be regular case studies and problems wherein the focus is going to be more around, uh, the user empathy, the problem-solving, the judgment and taste abilities of a candidate, and the thing that we are seeing new these days, that's the AI prototyping. Yes. This, uh, is the latest one, and for builder PM roles, this is the most commonly sought after skill. This is what we will see the most, I think, even in the coming two years for builder PM

5. 9:42 – 12:25

   How to use AI as a thought partner, not a writer

   1. SMSumant Malhotra9:42

      roles.

   2. AGAakash Gupta9:42

      Okay. And what might prompts look like?

   3. SMSumant Malhotra9:45

      Mm-hmm.

   4. AGAakash Gupta9:45

      So, like, I just got a prompt. I was helping somebody with Netflix homework, and it was like, "Submit no more than two pages" [laughs]

   5. SMSumant Malhotra9:55

      [laughs]

   6. AGAakash Gupta9:56

      ... for their strategy memo. Is that common? What are the, like, most common prompts within these buckets?

   7. SMSumant Malhotra10:01

      Uh, so there can be a number of ways in which, uh, people attempt these particular case studies. But, uh, more often than not, uh, prompts can include, uh, a structured markdown wherein, uh, they divide a long process into a context-aware decomposed prompt. I'll take an example of a PRD. Uh, typically, when, uh, people are building out product requirements document, there are multiple phases, right? It's not like we can write a PRD in one night, a functional PRD. Uh, there are various phases through which it evolves through. So if we go to any of these LLMs and directly ask them to build a PRD, sure, they will generate something, but will that be useful? No. So what we do typically is, uh, you know, we suggest candidates to go through the process, uh, s-write it down step by step, and, uh, showcase that process to AI so that LLMs understand what is the context and how to break it down in the same way. And then they go through it in a sequence. Th-that's one big God prompt that probably the candidate will write. And, uh, it will not just stop at the generation. It will go through multiple recursive iterations wherein AI probably have a red team evaluating, probably have, uh, uh, sub-agents, uh, checking out every step and, uh, marking it up or maybe providing feedback. And then based on that, that evaluation, a new generation is being created, and so on. The final result, it actually is pretty good because it has gone through so many filters. And we also suggest our candidates to do a quick human check, you know, basic- basically a human in the loop. Uh, we tell our candidates to constantly keep a human in the loop so that, uh, AI doesn't, you know, get astray too many times or hallucinates. And if it does, the human is there to guide it.

   8. AGAakash Gupta11:57

      Amazing. S- And I feel like with the rise of, like, Pangram and AI writing detection and Anthropic even watermarking their text-

   9. SMSumant Malhotra12:07

      Oh, yeah

   10. AGAakash Gupta12:07

       ... Google Gemini even watermarking their text with SynthID, you can expect probably OpenAI will follow. So basically, AI is just making itself known. And so it seems like the better model for people doing homework is AI as a thought partner, not as a writer.

6. 12:25 – 18:41

   Good example 1 - taking an LLM triage PoC to production

   1. SMSumant Malhotra12:25

      Absolutely.

   2. AGAakash Gupta12:25

      Okay. What does good look like? Can you walk through some real examples-

   3. SMSumant Malhotra12:29

      Sure

   4. AGAakash Gupta12:29

      ... for us today, just we're not just talking, but we can really see it?

   5. SMSumant Malhotra12:32

      Absolutely. Let me take you through some examples. I have, uh, taken, uh, real snapshots of, uh, presentations and slides and documents that, uh, were submitted. Uh, the good and the bad examples both come from real slides after due consent, of course. Uh, every data here is, uh, what was submitted. Uh, there is no mention of the person or the company here anywhere. If there was, it has been redacted. So let's just go through these examples. Okay? The focus will be towards, uh, understanding what are the good examples, and then I'll show you some bad ones as well. Uh, this first one, uh, this, uh, essentially was about an LLM incident triage proof of concept, and, uh, the candidate had to make a case for production, architecture, compliance, et cetera, for the same, right? So what this guy did was, uh, he essentially showcased a PoC versus a production scope himself, right? So this was the current state-

   6. AGAakash Gupta13:27

      Sorry, can I just interrupt you here?

   7. SMSumant Malhotra13:28

      Yeah, yeah. Of course.

   8. AGAakash Gupta13:29

      Because I feel like the question itself is kind of tricky. Can you explain, like-

   9. SMSumant Malhotra13:33

      Sure

   10. AGAakash Gupta13:33

       ... if somebody is seeing this-

   11. SMSumant Malhotra13:35

       Sure

   12. AGAakash Gupta13:35

       ... and they don't know what this is, what, what exactly were they asking for here in this question? Because I think even there you can learn a lot.

   13. SMSumant Malhotra13:42

       Absolutely. Right. So, uh, think of it this way. This is a incident triage tool. Yep. And, uh, the proof of concept was already there. The candidate was, uh, expected to go through the proof of concept and then make a case for the production, architecture, compliance, rollout, success metrics for this particular PoC. So to take a PoC from there to production-

   14. AGAakash Gupta14:06

       Mm-hmm

   15. SMSumant Malhotra14:06

       ... what are the various things that they were supposed to do? That is what the candidate was supposed to suggest.

   16. AGAakash Gupta14:11

       So this is one of the most important slides then that they would have, is like what does the PoC currently say versus what's the production scope?

   17. SMSumant Malhotra14:19

       Absolutely. Yep.

   18. AGAakash Gupta14:20

       Got it.

   19. SMSumant Malhotra14:20

       So, uh, I'll just take, uh, you quickly through, you know, the various things that the candidate wrote. Uh, the actual details are not as important as the logic behind why this works, okay? So I'll talk about that in a bit. Uh, like for example, the candidate mentioned that, uh, currently in PoC, we have the incident, uh, JSON structure coming in from static files, right? But in production state, uh, we will not really have static files because it just doesn't make sense. It's production. It has got to be real time, right? An incident cannot just keep waiting for it to be, uh, you know, kind of read through a static file. Hence, in the production state, it has to be a real-time event ingestion, maybe via APIs. Yep. The other lines also mention the same kind of a logic, right? Now, why this works is because, uh, even though the candidate has mentioned places where, uh, there would be, uh, one LLM call per incident to categorize it, or, uh, there would be suggestions taken from an AI, the candidate has not taken the easy path. I mean, the easiest path here, which a lot of people arguably will probably suggest is, uh, let AI handle it end-to-end, right? Just let the AI handle the incident, let it write the summary of it, let it even suggest what it should be the priority with, uh, sorry, what, uh, its priority should be, and, uh, what should be the next steps, et cetera. That's basically throw it in ChatGPT, get a response kind of a mindset.

   20. AGAakash Gupta15:50

       [laughs]

   21. SMSumant Malhotra15:51

       But, uh, the candidate actually went one step ahead and, uh, he had this, uh, throughout his sugge- uh, his submission, he had this, hard rules that were set above the model. The AI's role, like you only said, Aakash- It was supposed to be only there for suggestions. Yes. It was only supposed to be the thought partner. There was always rules that dictated, uh, you know, whatever AI is suggesting, does it cross this threshold? Only then the decision can be taken forward, and even then they had a human in the loop. The final decision was taken by a human only. That showcases maturity. That showcases real-time AI build experience. That was why this particular presentation was actually shortlisted, right? Similarly, uh, this was a very honest table wherein he showcased component by component, including what is, uh, still only in mocks. All of those things he included here. Despite, uh, that being a risk because, uh, it was, uh, untested, it was after all just a mock, uh, it... Despite that, he showcased his vision about, uh, how it is going to look like in future. I'll show you another slide. Uh, he showcased the value propositions in a very simple manner, along with the impact clearly mentioned, right? For example, the actionable recommendation I was talking about. He mentioned that, uh, it will provide operators with a verified starting point for remediation. Instead of, uh, just letting AI handle it end-to-end, which potentially can have a lot of dollar value loss in case something gets hallucinated, uh, here, uh, the impact would be that operators' life will become a lot easier. Yes. And then he mentioned those impact points in real numbers. Yes. He even had a slide specifically around how his proposal was following all the compliances, and he quoted the exact lines from the compliance rules that were being followed based on his proposal. This level of depth, this level of clarity, and honestly, this level of transparency in presenting what you have in mind, that's, uh, quite rare. That showcases maturity, and that's one of the biggest reason why this AI product and this presentation actually cut through. Make sense?

   22. AGAakash Gupta18:06

       Yeah. So it's almost like you're thinking about you versus the other three to four people doing the homework, and you're trying to come up with, "What am I demonstrating that potentially the other people may not demonstrate?" And maturity in terms of what AI can and can't do becomes a very powerful vector, and it feels like this person really triple-clicked on that. And another thing it seems like this person really focused on is they haven't built like super fancy slides or anything. They focused more on the quality of the content.

   23. SMSumant Malhotra18:39

       Absolutely.

   24. AGAakash Gupta18:40

       Got it. Okay.

7. 18:41 – 20:17

   The 20% most candidates miss - evals and economics

   1. SMSumant Malhotra18:41

      Let me, uh, demonstrate one more. Yep. Uh, so I'll just give a summary of the previous slides. Uh, the previous slides and in general the whole presentation, it worked really well because of the systems thinking wherein the candidate had showcased audit trails, uh, governance, phased rollout, et cetera. Right? So they showcased their experience in a regulated enterprise. But the thing that actually, uh, separates, uh, you know, the regular good from the elite is, uh, most of the candidates when they showcase their AI builds or their ideas, they, you know, simply push for some numbers, some big top accuracy numbers or precision numbers. But, uh, there was no real mention of eval methodology or any cost model per se, right? And because of those reasons, most of the good submissions, good ideas, good content sometimes also doesn't really make the cut because, well, they missed out one of the most important things. Yes? So this is where most candidates land, like just 80% of the way. Yeah. That 20% is, uh, actually evals and the economics behind it, and that's what many candidates just either forget or miss out on completely. This deck actually showed that. That's one big reason why this guy got shortlisted as well, right? Uh, yeah, go ahead.

   2. AGAakash Gupta20:05

      Yeah. So what I'm taking away is if we're building an AI feature, let's talk about evals-

   3. SMSumant Malhotra20:10

      Mm-hmm

   4. AGAakash Gupta20:10

      ... and pretty much any feature, let's connect it back to the business impact. Okay.

   5. SMSumant Malhotra20:16

      Yeah.

   6. AGAakash Gupta20:16

      Sounds good.

8. 20:17 – 26:28

   Good example 2 - unifying five data products

   1. SMSumant Malhotra20:17

      All right. Let me show you one more, uh, example. Uh, the ask here for the candidate was, uh, he applied for a AI data company, and, uh, they wanted him to unify a sprawling portfolio of five separate data products. These were products that they already had, and they had a bunch of other smaller products in their kitty as well. But they gave him these five, and they asked him to propose, uh, new data insights. Yep. And they gave him some sample tables, some structures, et cetera. The, the expectation was that the candidate himself will, uh, kind of figure out, uh, what to do with this. Yep. So, uh, he essentially, uh, went through the huge amount of data that they had already shared, uh, went and did some research around the competitors, uh, figured out, uh, from his contacts. He actually went and talked to some of his contacts and, uh, understood, uh, you know, why the users specifically use, uh, you know, some types of products. Like, I'm talking data products here. Uh, so what do most companies, especially in the insurance sector, uh, they use that data for? Mostly reporting template insights. They have separate teams that are doing just this. Then there is a larger team that is doing analytics. They require the data exploration tools. And then there is the tech team which simply wants the dump of data. So based on the users, this person segregated this, uh, list of products. There were oth-other ways as well. I remember because I was the one who kind of helped him through this. Uh, I remember there were at least two more ways in which, uh, we could have, uh, kind of sliced these products or bucketed them into different ways. We could have simply gone with the, let's say, a free tier product and paid tier products and all, right? Instead, we chose this because, uh, he found the way users use a product to be a better way of classifying, not just in the current times, but even looking at the future because-- and it was his vision that later on when we enable many of these products to be AI native, let's say AI native exploration, AI native insight building, et cetera. And as these products scale up, and let's say there are even newer products that are built internally like audit, even they will fit within one of these buckets. That was the level of envisioning this person was able to do, and that's not something any LLM can help you do directly. This is something that either you have or you don't. Yeah. This was one big reason why his presentation really got through the cut. Yep. And he didn't stop there. He actually mentioned all the rationales behind this structure and even the trade-offs, even mentioning, uh, the opportunity cost, something that is very rare these days. A lot of candidates, they never really talk about the opportunity cost as a trade-off. This guy did. You see? And yeah, go ahead.

   2. AGAakash Gupta23:25

      So first thing you need to do is you need to really have a deep understanding of the users before-

   3. SMSumant Malhotra23:33

      Right

   4. AGAakash Gupta23:33

      ... you just go and start to work on a solution. How did he get that deep understanding of how users are actually experiencing the products? Because let's say like even just using this Netflix example that I was helping somebody with, it was like the user of that product is studios who make movies, but neither I nor the candidate had made movies before. So how do you really get inside the head in a homework assignment?

   5. SMSumant Malhotra23:58

      Fair enough. Uh, so in this particular candidate's case, uh, he was from that same industry. He had some experience, uh, building similar products or rather data products in the past. And, uh, he was from the insurance sector. He had about three or four years of experience working there. So he understood that this is how the typical market in insurance sector works like, right? You have a platform, uh, you have partners, the TPAs, then you have employers that take services of these, and the employees' money is what's actually invested towards getting insurance, right? So he already knew this. He had a lot of contacts, especially with partners. Uh, he used to work with a platform earlier, so he knew this value chain. All he had to do was, uh, kind of, uh, find out his contacts that were employers and some employees. Employees are usually the easiest, yes. And, uh, based on that, he was able to fetch insights. These were real insights. I mean, it's always better to get it directly from the horse's mouth, isn't it?

   6. AGAakash Gupta25:00

      Mm.

   7. SMSumant Malhotra25:01

      On top of that, uh, he supplemented his own insights that he got directly with secondary research too. So this guy, I got to give credit where it's due. Uh, he uses a very interesting approach wherein he doesn't depend on just one set of deep research. Yes. He would get, let's say, Perplexity doing deep research. Uh, at the same time, there is a Gemini deep research running as well. There's probably a couple of agents on a different platform doing deep research as well. And, uh, at the end, what he does is he accumulates the whole context and gets it summarized so that in case, uh, one agent missed some specific points, the other one didn't. And, uh, because he got everything accumulated, uh, the proofs that were, well, more real, they would have multiple signals coming in from various researches. So that way he becomes extra sure that, uh, you know, what is being fed into his research is actually backed by multiple sources. So it actually reduces the amount of time that, uh, he has to go and figure out, okay, what was hallucinated, what was not, what's real, what's not real, et cetera. So his way of research, uh, it saves him time, makes it a bit more accurate. More importantly, he took the signals that he got from the secondary research, which were quite, uh, coherent with what he found in his primary research. That's how he went about

9. 26:28 – 32:22

   Should you take on every homework assignment?

   1. SMSumant Malhotra26:28

      this.

   2. AGAakash Gupta26:28

      Makes sense. So it sounds like this person succeeded in part because they did have the domain experience. Is there a case to be made that maybe you shouldn't always do every homework assignment? 'Cause these can take a lot of time. Maybe you should only do the ones that you can actually differentiate yourself and you actually have experience or-

   3. SMSumant Malhotra26:48

      Mm-hmm

   4. AGAakash Gupta26:48

      ... should you take on every homework assignment?

   5. SMSumant Malhotra26:50

      Uh, so I have a pretty subjective take on this because, uh, it applies to me as well. Uh, back in my university days, uh, I was faced with the same choice because we were applying to a lot of companies for our job applications. And, uh, I made a call that, uh, I'm gonna pick up some specific case studies and assignments, uh, in which, uh, I have the best chance of, uh, getting through, right? Because I don't want to miss out on an opportunity which looks custom-built for me. Yes. For the others, I can take a call depending on how good my chances are. Because if I know that there are candidates out there in the market who have better experience than me, who are a better fit for the role, and who will most probably be doing a better job at this case study because they just have the right contacts and I don't, then probably it's in my best interest to save that time, effort, and, uh, not incur the opportunity cost, isn't it?

   6. AGAakash Gupta27:46

      Hmm. Yeah. What I'm learning from both these presentations is that the person themselves could bring some sort of alpha to the question being asked. And so-

   7. SMSumant Malhotra27:55

      Absolutely

   8. AGAakash Gupta27:56

      ... there's sort of a homework selection meta game that you need to play And you need to say, "Can I really even get this role?" [chuckles] If so, then I'll spend the time on this homework, it sounds like.

   9. SMSumant Malhotra28:10

      The caveat here being if you push yourself for something, then you go all in. It's not a half measure kind of a scenario, right? Because you are, uh, not taking up other case studies so that you save time for the one that you really want to go for. That's what I did, and that's what I recommend to all my students, too.

   10. AGAakash Gupta28:31

       Okay. Makes sense.

   11. SMSumant Malhotra28:33

       Yep. All right. So, uh, now when he submitted this, uh, I'll just show you one more slide which he submitted. Uh, this was one slide where, uh, he was supposed to show an insight that can probably be extracted from the tables that are already there. So-- And it is quite text-heavy because he knew he had to write in a lot of content. It would be read by AI at the other end as well. So he was quite okay with the, the format being like this. The larger point why, uh, this thing got selected was that, uh, every insight here, yes, it's not just, uh, surface level. Yeah? It's not just vague and ambiguous or dependent on what we can build later. No. It is actually being built based on the data that was already shared. So these insights are being extracted from real tables and columns that were present inside the initial dataset. That way, the candidate is telling that, uh, "Yeah, I can use the data that you have provided, and based on that, I can bring out insights that probably aren't even there right now." There were at least three more insights like this. This is just to demonstrate that, uh, if a candidate wants to showcase depth and they want to do it, uh, with a bit more transparency, this is a way to do it.

   12. AGAakash Gupta29:49

       Makes sense.

   13. SMSumant Malhotra29:50

       Yep.

   14. AGAakash Gupta29:50

       So for-- It sounds like a overriding lesson from both of these decks is-

   15. SMSumant Malhotra29:55

       Mm-hmm

   16. AGAakash Gupta29:55

       ... quality of insight matters more than formatting.

   17. SMSumant Malhotra29:58

       Absolutely correct. Yep. After all, uh, it is not unheard of that, uh, companies are also leveraging AI to go through a lot of assignments that are getting submitted, and only the ones that get through the first pass of AI get through to human reviews. Anyway, so, uh, why did his presentations work? Uh, because, uh, every claim, uh, that he made, every insight that he suggested, everything was backed with real data. Uh, even the stakeholders that he mapped, uh, each one had their risks allocated, and, uh, that's essentially the same muscle as, uh, setting autonomy tiers for an AI agent about what each agent can do and where each one is at a risk, how do you handle those contingencies, et cetera. Right? The strongest AIPM homework that we just saw in these slides, if you notice, there was not a real mention of AI in it at all, even though the insights specifically mentioned that, yeah, the insight will be generated through generative AI coming into the mix and, you know, evaluating patterns based on that, telling what would be the right target. He didn't really go deep into talking about the models and all. Not at all. The rest of his presentation also talked only around, uh, what are the ideas and insights he has. And that actually brings me to a very important point about constraints. Yes? Uh, lot of the times, uh, presentations are, uh, showcased in a way that people like to go beyond the suggested number of slides or things that have been asked for. Candidates feel that it's a better idea to just, uh, go ahead and demonstrate, "I can do more than this." Yes? Uh, what do you think, Aakash? Should candidates do that? We are going to discuss this in detail a bit later, but I want you to have an opinion on this. Okay?

   18. AGAakash Gupta31:48

       Oh, I don't know. It feels like you're setting me up to be wrong. But-

   19. SMSumant Malhotra31:51

       [chuckles]

   20. AGAakash Gupta31:52

       ... I think if you are disciplined enough not to use AI and it doesn't smell like AI at all-

   21. SMSumant Malhotra31:59

       Mm-hmm

   22. AGAakash Gupta31:59

       ... and you wanna... Like in the Netflix example, what we ended up doing, they said, "Give us two-page document."

   23. SMSumant Malhotra32:05

       Yeah.

   24. AGAakash Gupta32:05

       So what we did is we had links [laughs] in the two-page document. You know-

   25. SMSumant Malhotra32:11

       Yeah

   26. AGAakash Gupta32:11

       ... here's a link to the prototype.

   27. SMSumant Malhotra32:14

       Yeah.

   28. AGAakash Gupta32:14

       Here's a link to our data study in case you wanna learn more.

   29. SMSumant Malhotra32:18

       Yeah.

   30. AGAakash Gupta32:18

       And we just didn't use AI through it. But I'm curious what your take is.

10. 32:22 – 36:15

    Bad example 1 - the MVP that tried to do everything

    1. SMSumant Malhotra32:22

       That's actually very much aligned to what I have in mind, but we'll talk about that later. Yep.

    2. AGAakash Gupta32:25

       [chuckles]

    3. SMSumant Malhotra32:26

       Now, uh, that I've shown you some good examples and, uh, reasons behind why they work, let me also demonstrate what are some bad examples. Now, uh, I understand I'm calling them bad examples, but, uh, you gotta really remember that, yeah, even one of these slides got shortlisted. [chuckles] So this is first of them. Uh, the ask from the candidate was to create an MVP for an app that revolutionizes the in-person live music experience. That was the broad idea. Okay? Now, this is an actual slide of what this person submitted, okay? If you notice, this is a slide that is, uh, showcasing the features of an MVP, and they are all over the place. I mean, I don't know about you, Aakash, but I personally don't feel that this app and the way it planned to revolutionize the in-person live music experience, it really required all of these. I, I don't think this is the right definition of an MVP. Uh, it just looks like, uh, whatever came into the mind, uh, nobody said no to that. Everything just got accumulated and got through into the MVP. Yes?

    4. AGAakash Gupta33:34

       Hmm.

    5. SMSumant Malhotra33:35

       Recruiters looking at this, when they see, okay, it's going all over the place, and it's not really testing the one core idea that solves the main problem, that moment, that's usually the red flag. We are one of the first people who would be like, "Okay, this guy, no." Right? That was a big, big, big challenge with this. Even though it has been written in tremendous detail and a lot of information has been provided, yet It misses out on the core idea of an MVP. Yep.

    6. AGAakash Gupta34:06

       Mm.

    7. SMSumant Malhotra34:07

       There's more. Uh, in one of his s-final slides, uh, he actually mentioned a very unique take on how to make money. He mentioned, uh, aggregating anonymized user data, uh, which is to be sold to vendors and event organizers. So again, I don't know about you, but, uh, I don't believe that selling, uh, user data is a great idea to be mentioned at all, especially during, uh, case study submissions. So yeah. [chuckles] The funny thing, uh, this deck, uh, back in '23, when it was submitted, it actually got through, and it was a top company. Yes. Again, it was only for an APM role, so I guess that's just them trying to give this person a chance. But today, this would probably not even survive the screening round of the presentation, yeah. The homework round itself will have at least, uh, three or four red flags, big P0 red flags attached to it. And, uh, the moment, uh, it gets to more than two red flags anywhere, the candidates are out. So yeah, [chuckles] perfect bad example. What's your take on this, Aakash?

    8. AGAakash Gupta35:11

       So it sounds like make sure that you're demonstrating that you're making tough choices.

    9. SMSumant Malhotra35:16

       Yes.

    10. AGAakash Gupta35:16

        Stick to the scope of the question. And if you're gonna propose something risky, like, hey, selling user data, at least maybe put the risks or put the flip side on there that, hey, there could be some brand reputation risk. We need to examine if this is standard practice, if this could be anonymized. Uh, maybe this could come up as something that the public doesn't like, so we need to understand if it's actually permissible. Maybe if they had put that, it would've been better.

    11. SMSumant Malhotra35:44

        Correct.

    12. AGAakash Gupta35:45

        Got it.

    13. SMSumant Malhotra35:45

        Absolutely correct, right. So, uh, that was the point I have wanted to highlight that, uh, yes, there might have been examples where people got through even with this, but that doesn't mean that it's gonna run today. Today, with, uh, AI doing first-round screenings, uh, catching these becomes a lot, lot, lot easier. I mean, there's not even any limited scope of human oversight at all now, you know. Uh, AI is going to flag it. The moment humans see it, you're out. I'll show you

11. 36:15 – 39:27

    Bad example 2 - AI features with no evals

    1. SMSumant Malhotra36:15

       one more bad example, right. This is a whole different, uh, presentation for a different topic altogether from a different candidate, okay. Uh, this candidate was supposed to perform a basic competitive analysis for a top tech platform and then suggest features to overcome their competition. Yeah. A very standard exercise that a lot of PMs or PM2 candidates get for homework, right. So, uh, what this person did was, uh, he mentioned two specific AI-powered features, yes, very clearly. And, uh, he essentially named their pricing, their models, put that on, uh, the roadmap, et cetera. But nowhere in the 14 slides mentioned anything on the specification front, like, uh, what exactly is the data that is feeding them? Uh, what kind of accuracy must these AI products actually have? Uh, what is the cost per request for them? What is the feature economics going to look like? Is it actually going to hit any success metrics? Are there any particular success metrics for this? Nothing at all. Yes. Essentially, it just, uh, became a quick, uh, I would say advertisement of AI products without any real depth of thought around what those products will actually be like, whether these are good propositions for us or not. Yes.

    2. AGAakash Gupta37:36

       Mm.

    3. SMSumant Malhotra37:37

       And it was made worse because, uh, he went ahead and, uh, I would say committed a blunder because he simply mentioned that, uh, "I'm gonna go ahead and add this into the priority queue, uh, as an initiative which will have a realistic delivery under six months." He mentioned everything, telemetries, revision, heuristics, fine-tuning, everything. But if you ask them, "Okay, is there a eval plan behind this?" Nothing. No mention at all. In fact, even this was written with bare minimum detail. Yes. Now, here comes the question. If you're not mentioning evals, if you're not even including that as part of your realistic delivery, then are we g-going, are we not going blindsided into this game? No? Uh, what if your AI is actually not that great? What if, uh, you are just, uh, shooting blind, right? That's the part which, uh, breaks the case for product managers, and that was the problem that this person's presentation had. Yes. This, unfortunately, is not even the first time I've seen this. There are other cases as well, which I have not quoted in my presentation, where candidates have made similar mistakes. Because like I told you earlier, evals and, uh, economics, these are the two E's that most candidates seem to miss out on. Because there's just way too much excitement on showcasing what an AI can do. Who wants to care about the boring numbers, isn't it?

    4. AGAakash Gupta39:01

       Mm. It almost feels like executives a couple years ago who just wanted to sprinkle AI on top of everything. You can't really do that in a PM homework assignment.

    5. SMSumant Malhotra39:10

       Absolutely correct. Yep. That is the problem. So, uh, yeah, these were just, uh, some examples, both good and bad, and that too from real instances. Hopefully, that added a lot of insights to our conversation.

    6. AGAakash Gupta39:23

       And some of these bad examples, they might have even been formatted better.

12. 39:27 – 49:12

    How to split your hours on a take-home

    1. SMSumant Malhotra39:27

       Yep.

    2. AGAakash Gupta39:27

       And so it really comes down to the insight. So what's the repeatable process for a PM? If I give, given a homework assignment, how do I go about executing on that homework assignment? Let's say I have 10 hours or six hours. How do I go about executing that time properly?

    3. SMSumant Malhotra39:44

       Mm-hmm. Mm. Uh, I mean, six hours is, uh, I'm guessing it's more of a guideline because, uh, many of these assignments might require, uh, some more time than that. Some of them, they even want you to go out and research manually, right? But, uh, even if I have to just give you a broad distribution, I would say focus A lot more, uh, in the initial couple of hours on, uh, understanding the problem statement in detail without worrying about how can I throw more AI into the mix. You are building an AI product, yeah. It's a assignment about an AI product. Focus on problem-solving is still gonna be there. Ultimately, it's the role of a product manager. Yes. If you don't have product sense, if you are not getting to the crux of the problem, then no matter how much of AI skills you possess, no matter how good your understanding is of evals, still not gonna cut it. Yes. So focus the first few hours only on understanding the problem properly, understanding its nuances, figuring out why something is going wrong. Yes. As much research as possible. Take help of AI, throw it all in. Yep. The next couple of hours is what you push for execution. This was the planning phase, now you push for execution, wherein you go ahead and, uh, start building out the structure of what your response is going to be like. What are the instances you're gonna quote? What your assumptions are? What are some open questions? Uh, what would be the outline of your answer? Uh, what would be each step which will feed into the next one? Yes. Uh, personally, if, uh, I tell you about one of the candidate examples that comes to my mind. He mentioned the same structure. Uh, he put an outline of his presentation, and when he got it reviewed by me, I gave him the feedback that this just sounds too nascent right now. Yeah. Because he was kind of, uh, jumping the gun. He had done his research, but, uh, he was too much in a rush to showcase the solutions he has thought of. Right?

    4. AGAakash Gupta41:56

       Mm.

    5. SMSumant Malhotra41:56

       Uh, gave him that feedback that you gotta go back and, uh, simply lay it down like, okay, this is the problem. This is the top priority problem because you still gotta do a prioritization. And then based on that priority only, showcase your solution, and even then mention the trade-offs. Yeah. You, you don't rush into solutions just headlong, right? You go ahead, mention the trade-offs and keep it flexible. You don't just say that, uh, you know, with an arrogant tone that, "Okay, this is what it is gonna be, nothing else." Yes. In, uh, presentations or even in general when, uh, we are proposing any ideas, it's always a better idea to have an air of modesty about it. Yep. And then finally, if you have time remaining, which hopefully you will these days, uh, using AI, go ahead and format it. If you have pushed for good content, if you have some time remaining, push for formatting. Make it readable though. Yes. The first focus has to be on readability. If it is not readable, if you are, uh, goofing up, uh, outlines, if you are goofing up alignment, it just looks unfiltered. It looks uncouth, honestly. Yes. You are a product manager. You are expected to understand basic design. Yes. You don't want to create a very bad first, first impression because this will be your first, first impression when this slide reaches someone, right? So have good enough formatting to keep it readable. Keep it, uh, in a format that is readable even by an AI. Yeah. Don't overcomplicate it. Don't make it too heavy by adding in too many images, et cetera. Uh, links, yes, you can add. Yes. Uh, but, uh, other than that, keep it minimal if possible, and, uh, focus a lot more on readability and solving a problem step by step. That is how I would have, uh, suggested a student to distribute their time. Uh, one caveat here is there will be cases where, uh, even the allotted time is not sufficient, and many candidates do send out emails that, "Okay, we need one more day because we were busy with something due to which we couldn't submit." My suggestion is, uh, that it might have worked a few times in the past for you. But these days, because even recruiters know that AI is available, my suggestion is don't. Figure out a way to complete things on time.

    6. AGAakash Gupta44:21

       So here we saw slides. What should-- A lot of people I've been talking to, they almost want to do an AI prototype for every homework assignment. Should you have an AI prototype in every assignment? And when does it even make sense to make a full-fledged app beyond a prototype?

    7. SMSumant Malhotra44:37

       Makes sense. Uh, this brings us back to the question I was asking, right? Uh, should the candidates go ahead and, uh, step towards something that has not probably been asked? Uh, is it not a great idea to just flaunt our prototyping skills? Yes. So here's the answer. Uh, if the role is a builder PM, if the prompt or the question that has been given to you in your take home says that you need to demonstrate it or prototype it or, or and rather, if the company's own product is also agentic, by all means, please go ahead, build a prototype. Yes, that's as simple as it gets. But if they have only asked for a PRD or any just, just document like competitive benchmark and all, right? Or if, uh, you know, uh, it's an app that they didn't really ask for, you know, uh... Sorry, what am I saying? Huh. Uh, if you still go ahead and build an app that they never really asked for, then it has a tendency to backfire because it will be perceived as, uh, you can't follow instructions or you are trying to unnecessarily spend time building something which nobody is asking you for. Basically, it becomes a question of prioritization. They would feel that you will probably try to flaunt off the same skills when we hire you, even though you have other things to do. That's basically extra cost to the company, [chuckles] not extra credit. That's why.

    8. AGAakash Gupta46:03

       Mm. So don't always just add it unless like really the role or the company calls for it.

    9. SMSumant Malhotra46:10

       Absolutely right. And, uh, even if you do build, right? Just Maybe build a thin slice just to showcase your idea, just to supplement your ideas, right? It should not be a huge, broad mock, very elaborate structure that you created. Just, just show the eval, right? Uh, not just the demonstration part. The idea is whatever is being asked, can you follow that instruction and create something really full of content, the real value for the recruiters? Because after all, it's part of the interview process. They are testing your skills, and they have other questions to test you on your other skills. Don't demonstrate everything that they didn't ask for in the same question.

    10. AGAakash Gupta46:54

        [lips smack] Stick to the prompt. And s- talking about sticking to the prompt.

    11. SMSumant Malhotra46:59

        Hmm.

    12. AGAakash Gupta46:59

        A lot of times they'll ask for just, like, one page or two page, and we wanna add an appendix or we wanna add more links. [chuckles] What's your take on that? Should you stick exactly to the length requirement?

    13. SMSumant Malhotra47:10

        Yes. If they have asked for one page, that's it. No, no negotiation that, that one, right? Even, [lips smack] uh, when we were discussing this earlier, you mentioned it yourself. You submitted two page. You did not really added on too many pages after that, right? Uh, you used a smart way. You had links present in those pages, and you redirected people to those links, right? But the submission was two pages only, right? That's the point. Following the constraint is also part of the test. Can you cut down the detailing to that level that you can cons- make it so concise that it can fit in one page or two pages? Sometimes that is what as PMs we might need to do. We might not have all the space in the world on a small mobile phone screen, but we will have way too many features to accommodate. Can we do that? That is what is being tested. Especially enterprise PMs, we, we live within these constraints almost all the time. Yes. Aakash, you have had your experience with enterprise products. What do you think?

    14. AGAakash Gupta48:17

        Yeah, I think so. Although I think that the links maybe is a little bit of the sort of hack. If you think that-

    15. SMSumant Malhotra48:26

        Yeah

    16. AGAakash Gupta48:26

        ... I've done all this work, maybe, um, like the first successful candidate, you actually went and talked to people in the four-

    17. SMSumant Malhotra48:33

        Mm-hmm

    18. AGAakash Gupta48:33

        ... buckets, partners, ecosystems, customers, and you want to show that off. I think you can use links strategically. Like, maybe you recorded those calls. Maybe you went even further, you put them into dovetail and you tagged the insights. Maybe you went even further and then you aggregated the insights and the quotes. If you really did all that work, it... I don't think it hurts you to summarize the key point, the key-

    19. SMSumant Malhotra48:59

        Mm-hmm

    20. AGAakash Gupta48:59

        ... takeaway, and then have a link. And so that to me, I think, is the one hack where maybe sometimes you can go beyond it, and hopefully not too many people will think, "Oh, he's just going outside of constraints."

13. 49:12 – 55:41

    The biggest mistakes candidates make

    1. SMSumant Malhotra49:12

       Absolutely agree. And that is what this point is. You send one page if they ask for one, and you add link for anyone who wants it more. That's it.

    2. AGAakash Gupta49:20

       So what are the biggest mistakes you see people make with homework?

    3. SMSumant Malhotra49:24

       Oh, there are a lot actually. Uh, I'll just quickly jump to that. Uh, even the greatest PMs, sometimes they end up making these very common pitfalls. Uh, like I mentioned earlier, sometimes, uh, you know, they will have very silly mistakes, uh, like a typo present on the first page of the deck itself. Interestingly, uh, there's a statistically higher probability of missing things out in the early half of anything that you're about to present rather than the latter half. You know that?

    4. AGAakash Gupta49:55

       No.

    5. SMSumant Malhotra49:55

       Uh, it happens because we typically have a bias towards the mid and the end. [chuckles] But, uh, we feel that the first part, uh, we have already had a good look at. It's never the case. So, uh, this is a very common problem. Uh, candidates, they end up polishing slide nine where they have written the conclusion, et cetera. But on the first page itself, when the presentation is about to start, the intro slide itself, they might goof up a spelling, misalign a text, et cetera. Yeah?

    6. AGAakash Gupta50:23

       Mm-hmm.

    7. SMSumant Malhotra50:24

       Very bad, very, very bad impression to create, especially when you are just starting out. You kind of, uh, build a perception in the mind of a recruiter that you lack attention to detail.

    8. AGAakash Gupta50:33

       Mm-hmm.

    9. SMSumant Malhotra50:33

       Not, not the thing you want to create. Yes. Next, uh, you know, kind of, uh, answering the prompt they wish they got. It's like, again, wishful thinking that, uh, "Oh, I think the question means this." Without going into good depth of what the question is really asking you for, without understanding why a particular problem is being tackled specifically, right? Instead, if the candidate just imagines that, okay, oh, this is what the problem must be asking. That's the problem. A lot of smart PMs, they also get into this. I remember one particular case. Uh, the candidate was, uh, asked about, uh, taking a decision around, uh, adding a few features and, uh, he had to decide which of these three suggested features would be the best fit. Was-- I would say not best fit, rather the best bet for the company. Yes. Uh, they were supposed to do market analysis, uh, arrange statistics and numbers for it, and based on that, create a calculated call. Yeah, that was the assignment. This person, in all their wisdom, they perceived it as a, a benchmarking and parity matching exercise, and that's all they did, and that's all they submitted. They did not really go through and mention which feature, uh, should actually be promoted further. They simply compared the three features with what other competitors were offering and simply showcased, uh, a benchmarking. Yeah. Similarly, uh, many people, especially the ones that, uh, are into getting AI to write things for them, uh, you will see there's a lot in their submissions. There would be sentences that say nothing like, "Leverage AI to revolutionize support." Man, revolutionize that itself is like right out there it is written by AI, right?

    10. AGAakash Gupta52:31

        [chuckles]

    11. SMSumant Malhotra52:31

        So, uh, nobody talks like that, and yet you will see these terms. Whenever I see something like this, whenever I see em dashes, whenever I see those, and not this, but this, these are absolute AI-isms, and they can be spotted on from a mile away.

    12. AGAakash Gupta52:46

        Mm-hmm.

    13. SMSumant Malhotra52:46

        So when you see that, even with great PMs, you will see sometimes they will just be like, "Ah, just... it's just a conclusion. Let's just get AI to summarize it." No, please humanize it. Spend some time, okay? Uh, missing out on numbers or worse, adding numbers anywhere. [chuckles] Uh, you know, uh, th- not adding a number where a number belongs and the vice versa, wherein you don't wanna put numbers at a place where you're drawing conclusions, and yet you will unnecessarily throw in numbers there. Both are wrong. Understand where a number is really supposed to be and then only put it there. Usually it's about storytelling. Yes. A well-stationed number, it supplements your story. You know? It just makes sense to see that number at that particular point of the story. But if you miss out on that, you're telling the recruiter that you're not really that good at telling a story. And for product managers, Aakash, you can attest to that. Storytelling, crucial skill. Very, very crucial skill, especially when you want to align your stakeholders. Man, not the perception you want to create in front of a recruiter that you're bad at storytelling. Okay? And finally, I think one of the most important points, and where I have seen personally a lot of people making mistake, they skip the defense. The defense requires prep. You can expect to be grilled upon the decisions that you have mentioned in your presentation. How can you not have really solid points to back your claims? Yes. It is not sufficient to just build a good presentation and crack that round. You gotta remember that many times during the interviews you will be asked questions about it, and you gotta remember the statistics, you gotta remember the format, you gotta remember every decision that you made that made you prioritize a particular feature above something else. What was the reasoning behind, uh, you know, putting this particular, uh, slide before the other, et cetera. Yeah. There are many other more mistakes like this that a lot of candidates do as well, but these are the ones that I've seen the most, so that's why I thought I'll just present these first.

    14. AGAakash Gupta54:53

        Yeah. Preparing the defense is so important. And that's, I think, where AI could actually be helpful. You can have AI read your document, read the prompt, and say, "Hey, what are the three biggest problems with this?"

    15. SMSumant Malhotra55:06

        Correct.

    16. AGAakash Gupta55:07

        What que- what are the three questions they're most likely to ask? And then practice.

    17. SMSumant Malhotra55:12

        Yeah.

    18. AGAakash Gupta55:12

        And maybe even check in with your recruiting buddies or coaches or this is where coaching can be helpful, I feel, also doing that rounds of iteration. And s- so if you let's say given four days to build a homework assignment, try to finish it with one or two days left at the end, not rushing until the end and emailing, "Can I have another day?"

    19. SMSumant Malhotra55:34

        Yeah.

    20. AGAakash Gupta55:34

        But actually finishing a little early so that you can spend time on this defense. That is very high ROI.

14. 55:41 – 59:24

    The 3-part system to succeed on PM homework

    1. SMSumant Malhotra55:41

       Absolutely correct.

    2. AGAakash Gupta55:41

       All right. So if we put this all together, everything people learned, what's the system to succeed on homework?

    3. SMSumant Malhotra55:47

       I'll mention three broad points, and that will summarize the system. First, be in a rush to understand the problem. Don't be in a rush to just send AI slop. Okay? Point number two, evaluate everything that, uh, you have written and get it reviewed as many times as possible. First through AI and yourself, next with someone experienced, someone who has actually done hiring or evaluated these in the past. That will give you, my God, so much concrete evaluation, concrete feedback. That adds just way too much value to your presentation, right? And thirdly, in order to succeed, uh, focus a lot more on the content. Yes. Don't worry too much about the formatting. Just keep it readable. Don't go into fancy templates. Yes. Focus a lot more on, uh, delivering value. Don't, uh, again, try to portray fancy keywords about AI. A lot of people are getting into the habit of throwing in embedding and this eval framework and whatnot. Yeah, all that is great, but focus more on the problem at hand and how are you going to solve it. Don't forget the evals. Don't forget the metrics. Don't forget the economic side of things. Mention those parts. You are applying for a AI product role after all. These are essential parts. Forget about the formatting. That part you can cover later. Just focus, laser focus towards just the value part, and that's how you do it.

    4. AGAakash Gupta57:27

       And that was a ton of value, all freely provided. Thank you so much for this Deep Dive. If people wanna find you online or work with you or learn more, where should they go?

    5. SMSumant Malhotra57:39

       Uh, so well, uh, interestingly, Aakash, I have also started my YouTube journey. Yes. So they can find me on my YouTube channel. I'm also there on LinkedIn, and, uh, I can also be found on Topmate for one-on-one consultations and other plans.

    6. AGAakash Gupta57:56

       All right, guys. I have been watching Sumant's content for a couple years now. He seems like somebody who's super dialed in, and if you've watched to the end, you've enjoyed his insights as much as me, so go give him a follow. Go subscribe to his YouTube channel, and we'll be bringing you more PM job searching content on this channel, so make sure you have subscribed here as well. Comment down below what you want me to cover next, and I'll see you in the next episode. I hope you learned as much from today's episode as I did. If you can do one thing that's totally free that would help the show, it would be to check that you're following on Apple and Spotify podcasts. Check that you've left ratings and reviews on those platforms. Check that you're subscribed on YouTube. Leave a like and a comment on this video, and then share it with your friends. We're trying to make better and better podcasts. After two years, we think we've gotten something pretty good going. So let us know what we can do to make it even better, who else we should interview, and we will put on the best shows we possibly can. Finally, don't forget my offer for the bundle. You get an entire year of my paid newsletter, plus my favorite AI tools, Bolt.new, Airtable, Speechify, Descript, Magic Patterns, Linear, Dovetail, Arise, and Mobbin. That's $27,000 worth of value for just $150. So check that out at bundle.aakashg.com if it interests you, and I can't wait to share our next episode soon. [outro music]

Episode duration: 59:29