Opinion: Silent portfolio killers: Why investment results aren’t the whole story

Myles Jackson

Most investors judge their portfolios by performance. Did the market go up? How much did the account grow? Those are sensible questions, but they often don’t give you the full picture.

The truth is underperformance isn’t just a market thing. Often, the damage happens quietly, behind the scenes and long before it shows up on the statement.

Some of the biggest threats are structural. They lurk inside the portfolio itself and can slowly undermine growth for years before they’re noticed.

What are these silent killers? Fees, taxes and surprises.

Fees are a companion of each holding. They’re unavoidable. Costs are embedded in fund expense ratios, trading fees, advisory charges and account-level charges. The real concern is when fees are excessive.

Each one may seem small on its own, but they add up. Over time, they compound and not in your favor. Many investors have no idea how much they’re paying each year.

In some cases, the investor might not even know what portion of their returns went to costs. Sadly, what you don’t see is hard to fix.

The good news is you have choices. Selecting low-cost investments and advisers with transparent pricing can help prevent excessive fees from eating into long-term returns.

Taxes are another slow leak. You don’t feel their impact until it’s too late. Every dollar of investment income or capital gains has consequences. Without tax-aware planning, investors often pay more than necessary. This erodes the potential for compound growth.

It’s not just the wealthy who are affected. Excessive trading and portfolio churn can generate sizable, unnecessary tax liabilities for even modest accounts. The gap between tax-efficient and tax-inefficient investing is measured not just in dollars but in years of financial progress.

Then there are surprises: risks hiding in plain sight. They might come from over-concentration in a single stock, an overweight position in a favorite sector or too much exposure to one asset class. Sometimes, what looks diversified isn’t.

Different investments can still move together in a downturn, exposing correlations no one noticed. Risk also hides in complex strategies that aren’t well understood. While it’s more difficult to control risk than either fees or taxes, understanding where your portfolio is vulnerable is essential to managing it.

 Part of the reason these problems go unnoticed is human nature. When markets are strong, confidence runs high. Growing account balances mask inefficiencies. The cracks become visible only after losses have already occurred when fixing them is harder and more costly.

The real danger is in the way these issues build over time. A small percentage lost to fees here, a higher tax bill there, a concentration risk left unaddressed – none seem urgent on their own. But together, they can create a structural drag that alters your long-term outcome, even if the short-term numbers look fine.

For larger portfolios, the absolute dollar impact can be substantial, and the lost opportunity for compounding is even more painful.

The way forward begins with clarity. Investors need to know what they’re paying, especially in hidden costs. They should understand how taxes affect not just annual returns, but decades of growth. And diversification needs to be examined beyond labels, asking how each holding interacts with the rest of the portfolio.

A portfolio, like a building, needs regular inspection. Left unchecked, small cracks grow wider. Fees, taxes and hidden risks don’t make headlines, but they work quietly in the background, eroding results year after year.

Performance matters, but it isn’t the whole story. Without attention to what’s happening underneath, even strong markets can leave investors wondering why they’re not as far ahead as they had hoped.

Myles Jackson is a wealth management adviser and vice president at SignalPoint Asset Management in Springfield. He can be reached at mjackson@signalpointinvest.com.