What Is an Index Fund and How Does It Actually Work

A 0.03% expense ratio and a 1% expense ratio sound like the same thing with a rounding error. On a $50,000 portfolio held for 30 years, the difference is roughly $40,000 — enough to change when you can retire.

That gap exists because of one design choice: whether a fund tries to beat the market, or simply owns it.

What an index fund actually is

An index fund is a portfolio built to copy a published list of securities — an index — rather than to pick winners.

The S&P 500 is a list of 500 large US companies. A total market index holds thousands. A bond index holds debt issued by governments and corporations. The index itself is just a rulebook: it says which securities are in, in what proportion, and when they get swapped out.

A fund that tracks the index buys the same things in the same proportions. When the index adds a company, the fund buys it. When it drops one, the fund sells.

No analyst decides that a particular stock looks cheap. There’s no committee debating whether to hold cash. The rulebook decides, and the fund follows.

Why they cost so little

Running an index fund is mostly administration: buy what the index says, handle inflows and outflows, keep the records straight.

Running an active fund is research: analysts, sector specialists, portfolio managers, trading desks. That’s a lot of salaries, and those salaries come out of the fund’s assets before returns reach you.

This is why a US total market index fund can charge 0.03% a year while an actively managed large-cap fund charges 0.7% to 1.2%. On $50,000, that’s $15 a year against $350 to $600.

The gap compounds. Fees are charged on the balance, so a higher fee doesn’t just cost you more each year — it shrinks the base that would otherwise have grown.

Tracking error, the part nobody mentions

An index fund doesn’t match its index exactly. It can’t.

Two costs drag it behind: the expense ratio, and the friction of trading as the index changes. Some funds also hold a small cash buffer to handle redemptions, which lags in a rising market.

The gap between a fund’s return and its index’s return is called tracking error. For a large, liquid index it’s typically a few hundredths of a percent a year. For obscure indices — small-cap in emerging markets, niche sector lists — it can be several tenths.

If two funds track the same index and one charges 0.03% while the other charges 0.25%, the cheaper one will almost always show lower tracking error. That’s the entire decision.

Do active funds ever win

Sometimes. Some managers beat their benchmark for years.

The problem is picking them in advance. A fund that outperformed for the last decade was often in a sector that happened to do well, and the people who bought it after that run frequently got the next decade’s underperformance.

Over long periods the majority of actively managed funds fail to beat their benchmark after fees. That isn’t a controversial claim — it’s what the standard scorecards keep finding. The funds that do win are hard to identify ahead of time, and the ones that win consistently are rarer still.

When an index fund isn’t the answer

Index funds are a default, not a religion. Three cases where they don’t fit.

You want a specific exposure. If you want only dividend payers, or only companies below a certain size, a rules-based index may exist but be thin and expensive. A specialist active fund might genuinely serve you better.

You’re managing tax across accounts. Index funds distribute capital gains when the index rebalances. In a taxable account, a manager who harvests losses can sometimes offset that. The advantage is real, but usually smaller than the fee difference.

You need income with stability. A pure bond index moves with rates. If you need predictable income, a ladder of individual bonds may fit better.

For most people building wealth over decades, none of these apply.

What to check before buying one

Four things, in order.

1. Expense ratio. Under 0.20% for a mainstream index. Under 0.10% is excellent.
2. What it actually tracks. Two funds called “global equity” can hold wildly different things.
3. Fund size. Very small funds get closed. Above $100 million is comfortable.
4. Tracking error. Published in the fund’s documents. Lower is better, and it should roughly match the fee.

The bottom line

An index fund is a way to own a market instead of betting on who will beat it. It gives up the chance of outperformance in exchange for a high probability of capturing what the market delivers, minus a tiny fee.

For someone with a 30-year horizon and no interest in researching companies, that trade is close to unbeatable. The 1% you don’t pay is the most reliable return you’ll ever get.