The Jefferson Fisher PodcastHow To Say 'No' Without Feeling Guilty | Jefferson Fisher
CHAPTERS
- 0:00 – 0:22
Why saying “no” triggers guilt—and the trap of overexplaining
The conversation opens with the common struggle: wanting to say no but feeling guilty because we assume we’re disappointing someone who cares. That guilt often leads to a reluctant “yes,” followed by regret and resentment.
- •Guilt often follows a needed “no,” especially with caring people
- •Self-talk turns empathy into pressure to comply
- •Saying yes to avoid guilt can feel like walking into a predictable trap
- •Regret (“I should’ve said no”) is a sign the boundary mattered
- 0:22 – 0:53
Reframing “no” as honesty in a caring relationship
Fisher reframes refusal as a form of authenticity: if someone truly cares about you, they’d want you to be honest about what you can and can’t do. A relationship that can’t tolerate a real no is one that pressures performance over truth.
- •A healthy relationship makes room for a genuine no
- •Authenticity is essential for real closeness
- •Fear of disappointing others often drives inauthentic responses
- •Context matters, but honesty remains the goal
- 0:53 – 1:53
Lead with the no: stop cushioning and stop using “but”
He recommends placing the refusal first rather than burying it under gratitude and excuses. Over-softening can sound inauthentic, and “but” tends to erase what came before it, undermining the message.
- •Say the refusal early and clearly (e.g., “I can’t make it…”)
- •Too much preface can sound performative or insincere
- •Using “but” often negates the initial appreciation
- •Simple, direct phrasing reduces confusion and negotiation
- 1:53 – 3:18
Use self-promises instead of excuses—and avoid the “no because” trap
Instead of piling on reasons, Fisher suggests grounding your no in commitments you’ve made to yourself. People are less likely to argue with a stated promise, and fewer excuses protect your credibility and reduce guilt.
- •“I’ve made a promise to myself…” is harder to contest
- •Excuses invite debate and can weaken credibility
- •The more you justify, the more you negotiate your boundary
- •Directness can be the kindest approach
- 3:18 – 4:49
When they’re upset after your no: pause, let the fire burn out, respond later
The discussion shifts to what happens when someone reacts emotionally to your boundary. Fisher advises not to match their dysregulation; wait before responding so you don’t escalate or say things you don’t mean.
- •Don’t respond immediately to an upset message
- •Give it time (minutes or even until the next day)
- •Time clarifies what actually needs a response
- •Assume overwhelm rather than malice when appropriate
- 4:49 – 5:29
Hold the line: disappointment is okay; disrespect isn’t
Once emotions cool, you can address the behavior directly and set standards for communication. The aim is to validate feelings (they can be disappointed) while refusing disrespectful delivery.
- •Name the boundary: “Your words are not okay with me”
- •Differentiate feelings from behavior
- •Decide what you will and won’t accept in conversation
- •Standards protect the relationship and your self-respect
- 5:29 – 6:09
Boundary language that works: make it about what you accept, not what they must do
Fisher contrasts reactive, accusatory language with boundary-based statements that focus on your response and limits. This shifts power away from arguing and toward calmly defining how you’ll engage.
- •Reactive: “You can’t talk to me that way” escalates conflict
- •Boundary-based: “I don’t respond to that volume” sets a limit
- •Make it a ‘me’ standard to reduce back-and-forth
- •Boundaries help you regain control of the interaction
- 6:09 – 7:17
Expect pushback early: people notice when you stop being endlessly available
They explore the transition from having few boundaries to having clear ones. Early on, others may protest because they were accustomed to your availability, but consistent honesty eventually becomes your new normal.
- •Respect often increases with consistent honesty
- •Initial backlash is common when patterns change
- •People may act surprised when you reclaim your time
- •Over time, boundaries become accepted and expected
- 7:17 – 8:41
A key principle: if a boundary upsets someone, it may be working
Fisher normalizes the discomfort that comes with changing relational dynamics. Short-term discomfort can lead to long-term peace, and repeated practice makes the emotional sting smaller over time.
- •Discomfort doesn’t mean the boundary is wrong
- •Boundaries create the separation they’re meant to create
- •Choose temporary discomfort for long-term peace
- •Practice makes the discomfort shorter and more manageable
- 8:41 – 9:44
Handling parental judgment: why it happens and why it hurts
The conversation moves into family dynamics, especially the feeling of being judged by parents. Judgment is framed as the opposite of understanding, often rooted in fear and a fixed perception of who you are.
- •Parental communication often lands as judgment (tone, comparisons, probing)
- •Judgment blocks curiosity and understanding
- •Being ‘seen’ through a fixed lens is emotionally draining
- •People struggle to set boundaries with parents who mean well
- 9:44 – 11:01
Boundaries with parents: limit time, limit topics, and translate judgment into care
Fisher suggests practical boundaries (time/space and topics) while also interpreting the underlying value behind the criticism. Responding to the care beneath the judgment can de-escalate tension and change the tone of the exchange.
- •Use time/space boundaries (arrive, connect, leave when needed)
- •Distance can be healthy when interactions are harmful
- •Certain topics can be off-limits
- •Reframe judgment as a clumsy expression of love and worry
- 11:01 – 13:57
Use a value-based script: ‘I can tell ____ is important to you’
He offers a specific conversational framework that responds to the need beneath the critique. By naming what matters to the parent (wellbeing, kids, security), you acknowledge care without accepting control.
- •Script: “I can tell [my wellbeing/parenting/security] is important to you”
- •Address the value, not the accusation
- •Acknowledgment reduces defensiveness and lowers conflict
- •Mothers (and parents) worry as part of their role
- 13:57 – 16:13
When it’s exhausting to be ‘emotionally mature’: choose when to engage, and use diffusers
They acknowledge that translating others’ emotions is tiring, so Fisher recommends selective engagement and simple phrases that defuse. “Maybe so” acknowledges without arguing, and redirecting to personal topics can steer away from conflict.
- •You don’t have to do the ‘mature translation’ every time
- •Sometimes the best move is ‘get in, get out’
- •Diffuser phrase: “Maybe so” acknowledges without debate
- •Redirect: “I’d rather hear about you” to avoid hot topics (e.g., politics)