Does Technical Analysis Work? A Backtest Audit Before You Trade

📅 Originally Published: May 2, 2026 · Last Reviewed and Updated: August 21, 2026

You have a rule with a smooth equity curve, a strong annualized return, and only a few ugly drawdowns. The platform labels the result profitable. The live decision is harder: should you trust it with money?

The chart cannot answer that question by itself. It does not show how many failed variants were tried before this one, which costs were left at zero, or whether the rule has ever faced a truly unseen period. Those omissions are where a convincing backtest can stop being useful.

This guide covers rules built from daily price or volume data, such as moving average, breakout, momentum, and mean-reversion systems. It does not judge judgment-based chart reading, intraday trading, high-frequency systems, or market-making. Readers testing a specific signal can also use the broader Trading Edge research hub to compare the rule with related tests.

What Does the Research Actually Say?

What do academic tests show? Results can look stronger in-sample and weaken after researchers account for rule selection, trading costs, and unseen data. That pattern does not make every technical rule useless; it means the final equity curve is only the start of the evidence.

Sullivan, Timmermann, and White applied White’s Reality Check to a large technical-rule universe. Their historical sample still contained a best rule with evidence of superior performance after the adjustment, so the paper does not support a blanket “nothing works” conclusion. Its durable lesson is about method: judge the winner against the search that produced it.

Bajgrowicz and Scaillet tested 7,846 daily Dow Jones rules from 1897 through 2011. Their False Discovery Rate test found that future winners were hard to select in advance, while even low trading costs erased much of the reported value. Rink extended the question to 6,406 rules across 23 developed and 18 emerging markets. Many markets showed strong in-sample results, but recent forecasting power and carryover from earlier winning rules were much weaker.

📚 Primary sources: Sullivan, Timmermann & White (1999) · Bajgrowicz & Scaillet (2012) · Rink (2023)

Read the studies as separate tests, not as one pooled experiment. They use different markets, periods, rule families, and methods, so their rule counts cannot be combined into one general survival rate.

Before the three gates, check the data and trade timing. Reject a test that uses future data, drops failed or delisted assets from the sample, mishandles splits or dividends, relies on stale prices, or assumes trades that could not have occurred. The three gates below start only after those basic checks are clean.

Gate 1: Was the Rule Chosen Before the Result?

The first gate asks whether the rule was fixed before its performance was known. If hundreds or thousands of versions were tried, the test must account for those extra chances to find a winner. A rule written down in advance starts with a cleaner evidence burden.

Suppose a researcher tests ten moving-average pairs, five stop-loss levels, four assets, three holding periods, and two start dates. The search now contains twelve hundred combinations, so reporting only the best curve hides the size of the test that produced it.

This is the core data-snooping problem: the winning rule can reflect skill, luck, or both. Looking only at the winner cannot separate them. Reality Check, Superior Predictive Ability tests, False Discovery Rate controls, and rules fixed in advance all address the same issue from different angles by judging the winner against the search that produced it.

Writing down a famous rule before your own test does not erase the older search that may have made it famous. A clean test today can reduce your own search bias, but it cannot prove that the rule first became popular without publication or selection effects.

Evidence that clears Gate 1

• The entry, exit, sizing, benchmark, and rebalance rules were written before the test.
• The researcher lists every material version tested, including discarded versions.
• The analysis adjusts for extra trials when more than one candidate rule was tested.
• Setting ranges were chosen for a clear market or trading reason instead of tuned around the best result.

Evidence that fails Gate 1

• The seller shows one optimized curve but will not state how many trials were run.
• The start date, asset, or setting window changes whenever the result weakens.
• The rule contains vague conditions that can be changed after each chart is visible.
• The reported p-value treats the winner as a single test even though a large universe was scanned.

At this stage, the signal name matters less than the disclosed search. A plain moving-average rule with weak results is easier to judge than a proprietary “AI signal” chosen from a hidden universe.

Ask how many rules, settings, assets, and dates were tested, because “this was the best setting” is not enough. The size of the search is part of the result.

Gate 2: Does the Rule Survive Real Trading Costs?

The second gate asks what happens after trading costs. The backtest must include the costs created by its own trades, using inputs that fit the instrument, account, order type, and venue. No single commission, slippage, spread, borrow cost, or tax rate fits every rule.

TradingView’s official Pine strategy docs state that a strategy applies no commission when commission settings are omitted and that the default slippage setting is zero. A zero input therefore models zero commission or zero slippage; whether that assumption is realistic must be justified for the rule, instrument, and venue.

📚 Platform docs: TradingView Pine strategy docs states the no-commission behavior when commission arguments are omitted and the zero default for slippage.

A realistic model does not mean inserting the same 0.05% commission and one-tick slippage into every strategy. The estimate should match the instrument, broker, order type, trade size, time of day, and sample period. A liquid ETF traded monthly has a different cost profile from a small-cap stock traded at the open. Short strategies may also need borrow fees and proof that shares were available to borrow.

Taxes need their own scenario because the result depends on account type, tax location, holding period, loss harvesting, cost basis, and the investor’s other gains and losses. A taxable investor and an IRA holder can run the same rule and face different after-tax outcomes, so one fixed annual drag cannot represent every strategy or investor.

A cost model that can be defended

1. Count actual entries and exits, including reversals and partial fills.
2. Apply broker fees and observed spread or slippage by trade.
3. Include financing and borrow costs when the rule uses leverage or shorts.
4. Run taxable and tax-advantaged cases side by side when taxes matter.
5. Show gross and net performance side by side so the cost contribution remains visible.

For readers using platform defaults, the related guide on TradingView settings for investors shows where zero-cost inputs and inherited signal settings enter the workflow. Its specific dollar model should still be judged on its own assumptions.

Gate 3: Does It Work on Unseen Data?

The third gate tests the complete rule on data that played no role in choosing it. Many polished in-sample results weaken once the rule faces a period it never saw.

A proper holdout is more than a later date range opened after the first test disappoints. The researcher decides the training period, validation method, benchmark, and pass threshold before looking at the holdout result. Once the holdout influences another parameter change, it has become part of the training process.

Rink tested this across many markets. The paper found significant in-sample outperformance in 13 of 23 developed markets and 14 of 18 emerging markets. The forecasting power also declined over time. Almost no developed markets remained predictable in the last two subperiods beginning in 2002, and almost all emerging markets were unpredictable in 2009-2016. Portfolios built from the best rules in the prior three-year window did not clearly beat buy-and-hold at zero costs; with positive trading costs, they lagged most of the time.

That result does not prove a new rule will fail, but it shows why an in-sample chart is incomplete evidence. Walk-forward tests, rolling refits, checks across markets, and a final untouched holdout can expose different weak points.

Questions for the unseen-data test

• Was the holdout period chosen before the researcher saw its performance?
• Were all parameters frozen before the holdout was opened?
• Does the benchmark match the asset, risk, and time in the market?
• Does performance survive more than one regime, market, or reasonable start date?
• Were costs updated for the holdout rather than copied from the training sample?

A rule that works only in one market or regime can still be useful when that limit is explicit and the allocation is designed around it. The problem begins when a narrow result is sold as a general answer.

A Reproducible 50/200-Day Test

The SPDR S&P 500 ETF Trust (SPY) test below shows how the three gates change the question. It does not estimate the general value of technical analysis; it checks one fixed moving-average crossover rule on one pinned daily SPY file.

The rule holds SPY when its 50-day simple moving average (SMA) is above its 200-day SMA. The signal is lagged by one trading day to avoid using today’s closing information for today’s position. The pinned file runs from January 4, 2010 through December 30, 2019 and contains 2,515 daily observations.

The signal changed position nine times and was invested for 79.7% of the observations. In this window, the gross crossover lagged buy-and-hold before transaction costs. Most of the difference came from missed market exposure rather than the 25-basis-point cost assumption. The final row adds an extra drag case, not a tax model. It does not simulate realized gains, holding periods, tax lots, losses, or rates for a specific account.

Method at a glance: one fixed moving-average crossover, a one-day signal lag, the pinned SPY file, and 25 basis points per position change. Full data, warm-up, and return-field limits are documented below.

📚 Pinned dataset: SPY daily CSV at fixed Git commit. The file hash and all four displayed paths were checked again on August 21, 2026; the current catalog runner also matched the 2.089× sensitivity path on the same file.

This test cannot answer whether a different rule, asset, or market period would succeed. It shows why the broad question must become a testable claim with a named rule, benchmark, period, data treatment, and cost model. For a deeper look at crossover-specific turnover, see SMA versus EMA crossover. For a visual example of selection bias, see trendline survivorship bias.

Decision Path: Reject, Paper-Test, or Allocate?

What you do next depends on which gate failed. A weak backtest does not need another signal layered on top; it needs cleaner evidence or a smaller claim.

Paper testing cannot confirm real slippage, market impact, partial fills, queue position, or whether shares will be available to borrow. Those require live trades, and real-money behavior can also differ from a simulated account.

Before a limited allocation

• Write the maximum position size and acceptable drawdown before trading.
• Define in advance the exact condition that would retire the rule from use.
• Keep a benchmark account or shadow portfolio for comparison.
• Record actual fills and costs instead of continuing to use backtest estimates.
• Do not use leverage merely to restore the return lost by a low-exposure rule.

A paper test is useful only if the rules remain frozen. Changing the settings after every loss creates a new in-sample search in real time. That may feel adaptive, but it destroys the forward evidence the test was meant to collect.

The broad question becomes useful only after the claim is narrowed to a rule, asset, benchmark, cost model, and unseen period. Without those fields, the evidence is too vague to support an allocation.

Technical Analysis FAQ

The Bottom Line

Does technical analysis work? Some rule sets have looked credible in-sample, and some technical methods can be tested for narrow risk or trading objectives. The studies reviewed here do not establish a general risk-control benefit. A polished backtest still does not deserve capital until selection, trading costs, and unseen-data performance have been tested separately.

Reject a rule when the search is hidden. Paper-test it when the rule is fixed but real costs or forward evidence are missing. Consider capital only after the rule survives all three gates and the position size can tolerate model failure. Before risking capital, write down which gate remains open and what evidence would close it.