Downsizing? Why a Mortgage Might Be Smarter Than Pulling From Your Investments

Back to Blog

You've decided to downsize. Maybe the kids have moved out, you're heading into retirement, or you simply want something smaller and easier to maintain. You'll sell the current home, pocket the equity, and buy something more modest. The question is: should you pay cash for the new place, or take out a mortgage?

For many people, "no mortgage" sounds like the obvious goal. But when you look at the math, using a mortgage and keeping your investments working for you can actually leave you in a stronger financial position over time.

The Instinct to Pay Cash

It's easy to understand the appeal. No monthly payment, no interest, no debt. It feels clean and simple. And emotionally, being "mortgage-free" carries real weight, especially heading into retirement.

But financial decisions work best when they account for more than just emotion. Paying cash for a home means pulling a large sum out of your investment portfolio—and that has consequences that aren't immediately obvious.

What You Give Up When You Pull From Investments

1. Lost Growth Potential

Money sitting in a diversified investment portfolio has historically earned between 7% and 10% annually over the long term (before inflation). When you pull $300,000 out to buy a house, that money stops compounding. Over 15 or 20 years, the growth you miss out on can be substantial.

2. Tax Consequences

Selling investments to generate cash usually triggers capital gains taxes. Depending on the type of account (taxable brokerage vs. retirement), the size of the withdrawal, and your tax bracket, you could owe a significant amount in federal and state taxes. A $300,000 withdrawal with $150,000 in gains could mean a tax bill of $22,500 or more at the federal long-term capital gains rate alone.

3. Reduced Liquidity and Flexibility

A paid-off house is an illiquid asset. If you need cash for a medical expense, a family emergency, or an opportunity, you can't easily tap your home equity without taking out a loan or selling the property. Keeping your investments intact gives you access to funds when you need them.

4. Disrupted Retirement Income

If your investment portfolio is generating dividends, interest, or planned withdrawals for retirement living expenses, pulling a large lump sum can disrupt that income stream and force you to rethink your entire withdrawal strategy.

How the Mortgage Alternative Works

Instead of paying cash, you use some of your home sale proceeds as a down payment (say 20% to 40%) and finance the rest with a mortgage. The remaining equity from the sale stays invested.

Here's what a side-by-side comparison might look like:

	Pay Cash	Use a Mortgage
New home price	$350,000	$350,000
Down payment	$350,000	$100,000 (28%)
Mortgage amount	$0	$250,000
Kept invested	$0	$250,000
Monthly mortgage payment	$0	~$1,660 (6.5%, 30-yr)
Investment growth over 15 yrs (7%)	$0	~$440,000
Total interest paid (15 yrs)	$0	~$149,000
Net benefit of investing	—	~$291,000 ahead

Even after accounting for the interest paid on the mortgage, the investment growth can significantly exceed the cost of borrowing. The spread between a 6.5% mortgage rate and a 7% average investment return may look small, but compounding on a large balance over time turns that gap into real money.

When This Strategy Makes the Most Sense

• You're earning a higher return than your mortgage rate. If your portfolio consistently earns more than what you're paying in mortgage interest, keeping the money invested is mathematically favorable.
• You have a long time horizon. Even in retirement, many people have 20 to 30+ years ahead of them. That's plenty of time for compounding to work.
• You value liquidity. Keeping money in investments means you can access it if needed, rather than having it locked up in your home.
• Selling investments would create a big tax event. If your holdings have significant unrealized gains, a large sale could push you into a higher tax bracket or trigger substantial capital gains taxes.
• You can comfortably afford the mortgage payment. This strategy works best when the monthly payment fits easily within your budget or retirement income plan.

When Paying Cash Might Be the Better Choice

This isn't a one-size-fits-all answer. Paying cash can make more sense if:

• The mortgage payment would create financial stress or anxiety
• Your investments are in conservative, low-return holdings that won't meaningfully outpace the mortgage rate
• You're pulling from cash reserves or low-growth savings rather than a diversified portfolio
• The peace of mind of no debt outweighs the potential financial upside
• You're in a very high tax bracket where mortgage interest deductions no longer apply (most people no longer itemize after the 2017 tax changes)

The Key Takeaway

"Pay off the house" isn't always the best financial advice, especially when you have a well-performing investment portfolio. By using a mortgage strategically, you can keep your money growing, maintain financial flexibility, avoid a major tax hit, and still move into the home you want.

The right decision depends on your complete financial picture—your income, expenses, risk tolerance, tax situation, and personal comfort level. A conversation with a knowledgeable loan officer (and your financial advisor) can help you see the numbers clearly and make the choice that's right for you.