What Is an Index Fund, Really
An index fund is the boring product that beats almost every clever one. Here's what it actually is, why it works, and the small print most explainers leave out.
Key takeaways
- An index fund owns every stock in a list rather than paying a manager to pick winners, and over a 20-year window that decision beats roughly 90% of the people who got paid to pick. S&P's SPIVA scorecard has put large-cap active underperformance above 90% over 20 years.
- Fees explain most of the gap: active funds typically charge 0.5% to 1.5% a year while index funds charge 0.03% to 0.15%, and over 30 years a 1% fee gap compounds into roughly a 25% smaller ending balance.
- For an S&P 500 fund the expense ratio should be under 0.10%, with VOO at 0.03% and SPY at 0.0945%, and anything over 0.20% tracking a major index means you are overpaying.
- Some active managers do beat the index in some windows, but you cannot identify them in advance with any reliability, and the average outcome of trying is worse than not trying.
- The word 'index fund' has become marketing, and a dividend aristocrat or ESG index fund is a custom rule set, sometimes an active strategy in passive clothing charging an active fee.
- The funds are not the edge, the discipline is. The hard part is not picking VTI, VXUS, and BND, it is not selling them when the market drops 30%, which it will, several times, over a normal investing life.
An index fund is a fund that owns every stock in a list. That's the entire trick. The list is called an index, the most famous one being the S&P 500 (the 500 largest US public companies). Instead of paying a manager to pick winners, you pay almost nothing to own the list. Over a 20-year window, that simple decision beats roughly 90% of the people who got paid to pick.
The way I think about it, an index fund is a vote against the idea that anyone (you, me, the guy on TV) can reliably pick stocks better than the average. Most evidence says they can't, after fees. The S&P Indices Versus Active (SPIVA) report has run this comparison for two decades and the result is boringly consistent: most active funds underperform their benchmark over long horizons, and the few that win in any given year are not the same names winning the next year.
Plain English
How an Index Fund Actually Holds the Stocks
When you buy $100 of an S&P 500 index fund, the fund pools your money with everyone else's and uses it to buy a slice of all 500 companies. Apple is roughly 7% of the index, so about $7 of your $100 ends up in Apple. The smallest name in the 500 is something like 0.01%, so a penny of your money buys it. Whenever the index rebalances (a company gets added or kicked out), the fund mirrors that move. You don't have to do anything.
There are two flavors. A traditional mutual fund, like Vanguard's VFIAX, prices once a day after market close. An ETF (exchange-traded fund), like Vanguard's VOO or BlackRock's IVV, trades on the stock exchange like a stock. Same underlying portfolio, different wrapper. ETFs are usually more tax-efficient because of how they're structured, and they're what most people I know default to now.
Why It Beats Active Funds Over Time
The math is unforgiving. The total return of all investors in the market, by definition, equals the market's return. If half the money beats the average before fees, the other half lags it. Then you subtract fees. Active funds typically charge 0.5% to 1.5% per year. Index funds charge 0.03% to 0.15%. Over 30 years, a 1% fee gap compounds into roughly a 25% smaller ending balance. That gap alone explains most of the SPIVA result.
This isn't an argument that no active manager beats the index. Some do, in some windows. The argument is that you can't identify them in advance with any reliability, and the average outcome of trying is worse than not trying. So the rational move for most people is to stop trying and just own the list.
The Fees and Tracking Error to Watch
Two numbers matter. The expense ratio is the annual fee, expressed as a percent of assets. For S&P 500 index funds, it should be under 0.10%. VOO is 0.03%. SPY (the original S&P ETF) is 0.0945%, more expensive than its peers because of legacy structure. If a fund tracking a major index charges over 0.20%, you're overpaying.
The second number is tracking error, which is how closely the fund's actual return matches the index it's supposed to mirror. A well-run S&P 500 fund should have tracking error well under 0.10% per year. Niche index funds (small-cap international, factor tilts) can have meaningfully higher tracking error because the underlying stocks are harder to trade. Look it up in the fund's annual report.
Where the Marketing Gets Slippery
“Index fund” has become a marketing word, and not every fund with that label is what you think it is. There are now thousands of indexes, and most of them are custom-built to make a particular fund's strategy look passive. A “dividend aristocrat index fund” or a “ESG index fund” is following a custom rule set, not the broad market. Sometimes that's fine. Sometimes the rule set is just an active strategy in passive clothing, charging an active fee. Read the index methodology in the prospectus. If you can't explain in one sentence what stocks the index holds, you don't actually know what you're buying.
Takeaway
Owning the S&P 500 (or a total US market fund) at 0.03% beats trying to be smart for almost everyone. The interesting question isn't whether index funds work. It's why anyone still pays a stockpicker 1% to lose to them.
What I'd Actually Do
For most people, three index funds cover the world: a total US stock market fund (VTI or equivalent), a total international stock fund (VXUS or equivalent), and a total bond fund (BND or equivalent). Pick a split, automate contributions, ignore the news. The hard part isn't which funds. It's not selling them when the market drops 30%, which it will, several times, across a normal investing life. The funds aren't the edge. The discipline is the edge.
Frequently asked questions
- What is an index fund in simple terms?
- An index fund is a fund that owns every stock in a list. The list is called an index, and the most famous one is the S&P 500, the 500 largest US public companies. Instead of paying a manager to pick winners, you pay almost nothing to own the whole list in the right proportions, so your returns track the index.
- Do index funds really beat active funds?
- Most of the time, yes, and the math is unforgiving about why. The total return of all investors equals the market's return by definition, so if half the money beats the average before fees, the other half lags. Then you subtract fees. The SPIVA report has run this comparison for two decades and most active funds underperform their benchmark over long horizons.
- What is the difference between an index mutual fund and an ETF?
- It's the wrapper, not the portfolio. A traditional index mutual fund like Vanguard's VFIAX prices once a day after the market closes. An ETF like VOO or BlackRock's IVV trades on the exchange like a stock, all day. Same underlying holdings. ETFs are usually more tax-efficient because of how they're structured, which is why most people default to them now.
- What is a good expense ratio for an index fund?
- For an S&P 500 index fund, under 0.10%. VOO charges 0.03%. SPY, the original S&P ETF, charges 0.0945%, more than its peers because of legacy structure. If a fund tracking a major index charges over 0.20%, you are overpaying, because the product is a commodity and the cheaper version holds the same stocks.
- What is tracking error and should I care?
- Tracking error is how closely a fund's actual return matches the index it's supposed to mirror, and yes, you should glance at it. A well-run S&P 500 fund should have tracking error well under 0.10% a year. Niche funds like small-cap international or factor tilts can run meaningfully higher because the underlying stocks are harder to trade. It's in the fund's annual report.
- How many index funds do I actually need?
- Three cover the world: a total US stock market fund like VTI, a total international stock fund like VXUS, and a total bond fund like BND. Pick a split, automate contributions, ignore the news. The hard part is never which funds. It is holding them through a 30% drawdown, which will happen several times across a normal investing life.
Written by
Tech Talk News Editorial
Computer engineering background. Writes about software, AI, markets, and real estate, and the places where the three meet.
More about the author