Choosing a Benchmark: How to Make a Fair Investment Comparison

A 10% return can look impressive, disappointing or entirely ordinary. The number has meaning only after it is placed beside a relevant comparison.

That is the purpose of a benchmark. A benchmark tracks a market segment and supplies a standard for evaluating an investment’s performance. Stock benchmarks can cover large or small U.S. companies, while bond benchmarks can follow segments such as taxable or municipal bonds.

Choosing the wrong benchmark does more than create an imperfect comparison. It can make ordinary performance look exceptional—or make an investment appear to have failed when it was never designed to follow that part of the market.

The benchmark must match what the investment owns

An index is an unmanaged group of securities whose combined performance can serve as a benchmark. Some indexes are broad, while others focus on a particular sector or type of security.

The essential matching principle is straightforward: compare like with like. A large-company U.S. stock fund may reasonably be compared with an index of large U.S. stocks. A small-company fund calls for a small-cap benchmark instead. For an individual stock, an industry-specific benchmark may be more informative than a broad stock-market index.

The highest-returning index is not automatically the best benchmark. Benchmark selection is about comparable exposure—not finding the most demanding hurdle after the results are known. A performance presentation using a different market segment from the investment strategy deserves closer scrutiny because the comparison is not apples to apples.

A useful fit test asks four questions:

1. Asset type: Does the benchmark cover stocks, bonds or the relevant mix?
2. Market segment: Does it reflect the investment’s company size, industry or other stated exposure?
3. Strategy: Is the investment designed to track the benchmark, beat it or pursue something materially different?
4. Time period: Are both returns measured over the same dates and under a consistent calculation method?

A fund’s quarterly report will often identify its stated index and show how performance compares. That is a practical starting point, but not necessarily the end of the analysis.

Different reference points answer different questions

One investment can legitimately be viewed against more than one reference point. The mistake is treating those comparisons as interchangeable.

Fund-rating companies assign mutual funds and ETFs to peer groups of similar funds that provide another way to put performance in context. Separately, progress toward an investment goal may matter more to an investor than whether every holding beats a market index.

An alternative-strategy benchmark has a narrower use. Someone considering a change in approach might compare a current portfolio with a benchmark resembling the contemplated strategy. But that comparison answers “How did these approaches differ?” rather than “Did the current portfolio beat a fair benchmark?”

Returns alone do not settle the comparison

Suppose a fund returned 10% annually over a period. If its comparable benchmark returned 12%, the fund lagged. If the benchmark returned 8%, it exceeded the benchmark. This difference is often called excess return: the investment return minus the benchmark return.

Costs help explain why the comparison must be handled carefully. A market index does not itself bear the fund expenses paid by an investor, and benchmark performance may exclude fees that would reduce actual investment returns. Index funds seek to track their benchmarks, while active funds try to outperform a stated benchmark; costs reduce results relative to either objective.

Risk adds another dimension. A fund that trails its benchmark while taking less risk is not equivalent to one that trails while taking more risk. Fund reports may include returns and the standard deviation of those returns to help readers assess how much variability was involved. That does not make underperformance irrelevant; it means the return gap should be interpreted alongside the risk assumed.

The intended strategy matters as well. Index investing seeks more predictable performance relative to a selected benchmark. Active investing offers an opportunity to outperform but also creates greater variability around benchmark returns that should be considered alongside the market segment’s risk.

How a benchmark can mislead

A benchmark gives context, but it is not a neutral truth machine. A specialized fund compared only with a broad-market index may look unusually strong or weak because the two held different exposures. Research also identifies the possibility that funds have discretion to select benchmarks strategically, although the extent and influence of strategic selection remain open questions rather than established explanations for every mismatch.

Three checks can expose a weak presentation:

• Inspect the calculation method. Treatment of dividends, taxes and market conditions can affect how performance is presented. Returns that look directly comparable may have been calculated differently.
• Examine the dates. A single quarter or year can be skewed by one-time events. Comparisons over several years provide a broader view, while presentations covering only favorable periods may be cherry-picked.
• Ask whether the benchmark bears comparable costs. A fund’s net return and a cost-free index result are not economically identical, even when the index is the correct market match.

Historical and hypothetical results also require different labels. Past performance represents actual historical information, while back-testing applies a strategy to earlier market conditions to estimate how it might have performed. Back-tested results are hypothetical and do not constitute actual performance.

What the comparison cannot tell you

Even a well-matched benchmark does not explain every performance difference, establish that an investment met a financial goal or identify what will outperform next. It measures relative historical results within a defined frame.

Nor does lagging a benchmark automatically prove that an investment was defective. Costs, risk level, strategy and tracking differences all affect the result. Conversely, beating a mismatched benchmark does not demonstrate skill. The first question is not “Which return was higher?” but “Was this the right comparison?”

Finally, both the investment and its benchmark describe the past. Historical benchmark comparisons provide no guarantee that either side will behave similarly in the future. A benchmark is most useful as a measuring tool—not as a forecast, promise or substitute for understanding the investment’s role.

Sources

1. Get Off the Bench: A Look at Benchmarks | FINRA.org — finra.org
2. Keeping performance in perspective – The Vanguard Group, Inc — investor.vanguard.com
3. Investor Bulletin: Performance Claims — investor.gov
4. Considerations for active fund investing — corporate.vanguard.com
5. [PDF] Understanding Investment Quality and Performance Benchmarks — sec.gov