Often yes — it's worth running the math, especially if you have liquidity sitting in low-yield accounts.
The setup: let's say your current balance is $880,000, just $47,250 over the 2026 baseline conforming limit of $832,750 (you're not in a high-cost county). Your jumbo rate is 6.5%; conforming would be 6.0%. The 0.5% rate difference on $832,750 is roughly $260/month, or $93,600 over 30 years.
To get into conforming territory, you'd pay down $47,250. If that money is sitting in a 4.5% money market, you're giving up $2,126/year in interest income. The mortgage savings are $260/month or $3,120/year — net win of $994/year, plus you're now 47K closer to fully owning your home. Plus the $47K is "earning" the mortgage rate by reducing it, which is risk-free 6.5% on that capital.
The math gets more compelling at higher rate-spread differences. At 1% spread (7% jumbo vs 6% conforming), the same paydown saves over $5,000/year vs $2,126 forgone interest — clear win.
Does it backfire? Only if the rate spread is small (under 0.25%) or you have higher-yield investments earning materially more than the mortgage rate. The right answer depends on your full balance sheet — not just the mortgage in isolation.