How Much Money Do You Really Need to Retire? The $1 Million Myth [Ep. 34] 

Listen On

• YouTube
• Spotify
• Podbean
• Amazon Music
• Apple Podcasts

About This Episode

Ask most people how much they need to retire, and you’ll get some version of the same answer: a round number. A million dollars. Two million. Five million. It’s the question every retirement conversation seems to start with, and according to Glen Smith, Founder, CEO & CIO of GDS Wealth Management, and Robert Casey, Senior Vice President & Cofounder, it’s also the wrong one. 

In the latest episode of GDS Unplugged, Glen and Robert unpack why chasing a single “magic number” can set retirees up for a false sense of security, and what a real plan needs to account for instead.

The Gas Tank Problem

Glen frames the issue with a simple comparison: asking how much you need in retirement without talking about spending is like asking how much gas you need without knowing how far you’re driving. A hybrid and an SUV don’t get the same mileage, and two households with different goals, health situations, and lifestyles don’t need the same retirement number either. 

That’s the core problem with the old “$1 million and you’re set” rule of thumb. As Glen puts it, it’s hard to believe that 80 or 90 percent of people on the planet could hit the exact same number and all be equally prepared when no two people’s goals, life expectancy, tax situations, or healthcare needs are the same. 

Is the $1 Million Number Dead?

They point out that some clients worth $10 or $20 million still live frugally, while others with $4 or $5 million need to be put on a budget because they aren’t on track. Net worth alone doesn’t tell the story; spending does. 

That’s also where a common miscalculation creeps in. Someone who says they can live on $40,000 a year today isn’t accounting for the fact that $40,000 in 20 or 30 years, after inflation, might actually be $100,000 or $150,000 in future dollars. The plan has to translate today’s spending into tomorrow’s dollars, not just multiply a lump sum. 

Why the 4% Rule Can Mislead

The classic 4% withdrawal rule runs into the same issue. Someone targeting $6 million might calculate that 4% gets them to roughly $240,000 a year, and stop there. But if that target income need is 15 or 20 years away, $250,000 today won’t buy the same lifestyle by the time they retire. The number they’re solving for has to keep moving with inflation, or the whole plan quietly falls short. 

The biggest mistakes they see are plans that don’t properly account for taxation (especially with tax brackets relatively low by historical standards), that underestimate healthcare, which carries one of the highest inflation rates of any sector, and that assume spending will drop in retirement. In practice, spending often goes up, especially in retirement’s first phase, before tapering off later. 

Retirement Lifestyle Creep

Glen and Robert also dig into a pattern they see often: lifestyle creep. As income rises during a career, spending tends to rise with it: a nicer house, a nicer car, and better vacations. There’s nothing inherently wrong with that, they say, as long as it’s self-aware and built into the plan, because every dollar spent today affects the retirement picture tomorrow. 

The math gets concrete quickly. Using the 4% rule, an extra $1,000 a month in spending, $12,000 a year, translates to roughly $300,000 more needed today to sustain it. Small upgrades compound into large numbers. 

They tie this back to The Millionaire Next Door: many of the wealthiest people don’t drive the flashiest cars or live in the biggest houses. Warren Buffett is the example Glen and Robert return to. He’s reportedly lived in the same home for more than 65 years, bought for around $30,000, and estimated today to be worth $1.2 to $1.5 million, despite being one of the wealthiest people in the world. As Glen notes, Buffett does have a private plane, so everyone has their splurges, but the broader point stands: most people don’t retire broke because of the stock market. They retire broke because they fell in love with a lifestyle built on keeping up with everyone else. 

Can You Retire Early Without Being Insanely Rich?

Robert says it comes back to having a plan that accounts for every shortfall, not just returns. He is blunt about how he wants clients to measure the firm’s value: not by chasing performance, but by whether the plan actually gets them to retirement and through a realistic life expectancy, planning for the possibility of living into their 90s, not just an average lifespan. 

That also means building plans around worst-case scenarios. If a plan is built to account for something like 2008 happening again, a client can stay confident through actual volatility instead of reacting emotionally to it. Robert also flags a common miscalculation: assuming a retirement portfolio will earn “what the stock market averages,” often 10%, without acknowledging that number usually reflects a 100% equity portfolio, a level of risk most retirees aren’t actually comfortable holding through a 20-30% drawdown. 

If the Plan Is Behind, What Are the Levers? 

For anyone behind on retirement savings, Robert points to a few common levers: increasing savings, and eliminating what he calls “silent killers,” poor cash management, unnecessary debt, and a lack of tax planning. Robert shares a personal example: reviewing his own family’s spending annually, and making a deliberate choice to spend more on extra tutoring for a son who is severely dyslexic, understanding that it affects his own future retirement, but building it into the plan rather than ignoring the tradeoff. 

The bigger risk, Glen notes, is trying to do everything at once with no real budget, funding every goal for every family member with no framework, until spending is out of control. 

What Should You Take Away From This?

Freedom beats fantasy. A plan isn’t a single number or a system; it has to encompass everything that matters to you, not just returns. 

Clarity matters as much as the plan itself. Knowing what you’re aiming for is what makes it possible to hit it. 

Something is better than nothing. Some financial advisors may focus primarily on investment management rather than comprehensive financial planning. Having a plan that is regularly monitored and adjusted as taxes, markets, and life circumstances change can be more beneficial than having no plan at all. 

Volatility creates opportunity, if you have a plan for it. The instinct in a downturn is often to pull back further, when a well-built plan and an engaged advisor may see it as a chance to rebalance instead. 

Final Thoughts 

Retirement planning often gets reduced to a single headline figure, but as Glen and Robert discuss, the real work is in the details: spending, inflation, taxes, healthcare, and the discipline to stick with a plan through both good markets and bad ones. 

At GDS Wealth Management, we believe wealth management should extend beyond investment management alone. As a fee-only fiduciary firm, we coordinate financial planning, investment management, retirement planning, tax planning, and estate and legacy considerations to help clients build a plan around their actual goals, not a one-size-fits-all number. 

Watch the full episode of GDS Unplugged to hear the complete conversation between Glen and Robert. If you’d like to discuss your own retirement number, you can schedule a complimentary consultation.