The History of the Efficient Market Hypothesis: From Origins to Modern Finance

Can you beat the market? It’s the ultimate financial fantasy. We all dream of finding that one undervalued stock, that secret trading strategy, or that sliver of information that lets us buy low and sell high, turning a modest investment into a fortune. We read books, follow gurus, and analyze charts, all driven by the belief that with enough skill or insight, we can outsmart everyone else. But what if that entire premise is wrong? What if the market already knows everything you know, and everything you *could* know? This is the central, controversial idea behind one of the most powerful concepts in modern finance: the Efficient Market Hypothesis (EMH).

In simple terms, the EMH suggests that the price of an asset (like a stock or a bond) already reflects all available information about it. If this is true, then there are no “undervalued” stocks or “easy wins” to be found. The current price is the *correct* price, given what is known. Trying to “beat the market” is as futile as trying to win a coin-tossing contest through skill. This idea wasn’t born overnight. It was the result of a long, century-spanning debate among some of history’s greatest economic minds. This is the story of how that idea came to be.

The seeds of efficiency: Early economic thought 🔗

Long before anyone talked about “stock market efficiency,” classical economists were busy trying to figure out a more fundamental question: Where do prices come from? Their answers laid the intellectual groundwork for the EMH, even if they never envisioned a world of high-speed trading and complex derivatives. The seeds were sown in the simple, powerful idea that markets are information-processing machines.

What did classical economists think about prices? 🔗

Think of Adam Smith’s famous “invisible hand.” He proposed that when individuals act in their own self-interest, an unseen force guides the market to produce the best outcome for everyone. This “hand” works because the price system acts as a giant signaling mechanism. A high price signals scarcity and high demand, encouraging producers to make more. A low price signals a surplus, telling them to back off. Prices, in effect, contain information.

Building on this, economists in the late 19th and early 20th centuries refined this idea. Figures like John Bates Clark explored the concept of “perfect competition.” In such a (theoretical) market, all buyers and sellers are price-takers, and information is freely available. In this world, the price of a good or service must, by definition, equal its true economic value (or “marginal utility”). There’s no room for mispricing because if a price were “wrong,” competitors would instantly enter the market and correct it through arbitrage.

Simultaneously, Alfred Marshall gave us the most famous diagram in economics: the supply and demand curves. The point where they cross is the “equilibrium price.” This isn’t just a random number; it is the *only* price where the market “clears”-where the quantity buyers want to buy perfectly matches the quantity sellers want to sell. This equilibrium price is the market’s best guess at value, based on *all information* available to both buyers and sellers at that moment. While Clark and Marshall were talking about wheat and textiles, not stocks, they established a profound principle: competitive markets are incredibly good at absorbing information and reflecting it in a single number-the price.

The plot twist: A forgotten mathematician and a ‘random walk’ 🔗

The story of the EMH takes a fascinating and long-overlooked detour to Paris in the year 1900. While mainstream economists were focused on *why* prices settled at an equilibrium, a young French mathematician named Louis Bachelier was asking a different question: How do prices *move* from one moment to the next?

Louis Bachelier’s phantom discovery 🔗

For his doctoral thesis, “The Theory of Speculation,” Bachelier decided to mathematically model the fluctuations of government bond prices on the Paris Bourse. He wasn’t an economist, so he wasn’t burdened by theories of “value” or “equilibrium.” He just looked at the numbers. And what he found was remarkable.

Bachelier observed that the price changes were, for all intents and purposes, random. They were as likely to go up as they were to go down, regardless of what had happened in the past. He was the first person to formally model what would later be called a “random walk.” His profound insight was this: in a speculative market, the current price already reflects the best guess of all participants. Therefore, any *new* information, which is by definition unpredictable, is what causes the price to change. Since new information is random, the price changes must also be random.

His thesis committee, which included the famous mathematician Henri Poincaré, praised his innovative mathematics but seemed to completely miss the economic implications. His work was filed away and largely forgotten by economists for more than 50 years. The world of finance, it seemed, wasn’t ready for his idea.

The birth of the modern hypothesis 🔗

Bachelier’s seed of an idea lay dormant until the 1950s and 1960s when a new generation of economists, armed with better data and computing power, began to re-examine the behavior of financial markets. They rediscovered Bachelier’s work, and the modern Efficient Market Hypothesis began to take shape.

Rediscovering the ‘random walk’ 🔗

One of the giants who dusted off Bachelier’s thesis was Paul Samuelson, a Nobel laureate and one of the most influential economists of the 20th century. In a 1965 paper, Samuelson provided the rigorous mathematical proof for *why* prices should move randomly in a well-functioning market. He argued that if any information (like an earnings report) could be used to predict a future price change, speculators would rush to trade on it. Their very act of trading would *instantly* push the price to its “correct” new level, eliminating the profit opportunity. In a competitive market, all predictable patterns are arbitraged away immediately. The only thing left to move prices is new, unpredictable information-hence, a random walk.

Taking the idea to Wall Street 🔗

While Samuelson provided the academic rigor, economist Burton Malkiel brought the idea to the masses. In 1973, he published his blockbuster book, A Random Walk Down Wall Street. Malkiel presented the academic evidence in clear, accessible language and famously argued:

“A blindfolded monkey throwing darts at a newspaper’s financial pages could select a portfolio that would do just as well as one carefully selected by the experts.”

This single, provocative image did more to popularize the core idea of market efficiency than any academic paper. It was a direct assault on the entire industry of professional stock pickers and technical analysts, who claimed to have special skills. Malkiel’s point was simple: if prices are a random walk, then all that time spent analyzing charts or picking “winning” stocks is a complete waste of time and money.

Eugene Fama draws the map 🔗

While many people contributed to the idea, the undisputed “father of the Efficient Market Hypothesis” is economist Eugene Fama. In the mid-1960s, Fama (who would later win the Nobel Prize for this work) took all these separate threads-classical equilibrium, Bachelier’s random walk, Samuelson’s proof-and synthesized them into a comprehensive and testable theory.

Fama’s 1965 cornerstone publication 🔗

In his 1965 dissertation and a related article, “Random Walks in Stock Market Prices,” Fama conducted one of the first large-scale empirical tests of the idea. He meticulously analyzed decades of stock price data, looking for predictable patterns. His conclusion was blunt: the evidence was overwhelming. Past price movements had virtually no predictive power for future price movements. The “random walk” wasn’t just a theory; it was an observable fact in the data. He argued that this randomness was the *sign* of an efficient market, one that quickly processes information.

The three forms of efficiency: Fama’s lasting framework 🔗

Fama’s most enduring contribution, however, came in his 1970 review paper, “Efficient Capital Markets.” He realized that “efficiency” wasn’t an all-or-nothing concept. He proposed that there were three forms (or levels) of the EMH, which defined the debate for decades to come.

• The Weak Form: This is the random walk theory. It asserts that you cannot predict future stock prices by analyzing *past price data*. All historical information is already reflected in the current price. This form implies that “technical analysis” (looking for patterns in charts) is useless.
• The Semi-Strong Form: This form asserts that prices adjust instantly to all *publicly available information*. This includes everything from news articles and company earnings reports to Federal Reserve announcements and industry trends. This form implies that “fundamental analysis” (researching a company’s financials) is also useless for finding “undervalued” stocks, because by the time you read the report, the market has already priced it in.
• The Strong Form: This is the most extreme version. It asserts that prices reflect *all information*-public and private (i.e., insider information). This form implies that not even corporate insiders with secret knowledge can consistently beat the market (perhaps because their trading is illegal and restricted, or the market is just *that* good at sniffing out information).

This framework was revolutionary. It turned a vague idea into a set of specific, testable hypotheses. Most researchers, including Fama himself, quickly agreed that the Weak Form holds true. The real fight, which continues today, is over the Semi-Strong form.

The enduring debate and profound influence 🔗

The EMH was not just an academic theory; it was a declaration of war on Wall Street’s entire business model. And Wall Street, along with a new school of economists, fought back hard. The debate has raged ever since, yet the theory’s influence is undeniable.

The behavioral finance counter-attack 🔗

The biggest challenge to the EMH came from a new field: behavioral economics. Led by psychologists like Daniel Kahneman and Amos Tversky, and economists like Robert Shiller (who ironically shared the 2013 Nobel Prize with Fama), this school argued that EMH has one giant, fatal flaw: it assumes investors are perfectly rational. But they aren’t. People are… well, people. We are driven by fear, greed, overconfidence, and herd behavior.

Behavioral finance points to “anomalies” and real-world events that EMH can’t easily explain:

• Market Bubbles: How can an “efficient” market explain the 2000 Dot-com bubble, where companies with no profits were valued at billions? Or the 2008 financial crisis, where complex assets were disastrously mispriced for years?
• Excess Volatility: Shiller showed that stock markets are far *more* volatile than changes in underlying company fundamentals (like dividends) would suggest. He argued this extra volatility is driven by human psychology-“irrational exuberance.”
• Successful Investors: What about investors like Warren Buffett, who has consistently beaten the market for decades? Fama might call him a “statistical outlier”-if you have thousands of people flipping coins, one is bound to get heads 20 times in a row. Behavioralists see him as proof that markets aren’t efficient and that finding long-term value (a skill) is possible.

The EMH’s practical legacy: The index fund 🔗

Despite these powerful critiques, the EMH remains arguably the most influential financial theory of the 20th century. Its impact is not just academic; it changed how millions of people invest their money. The theory’s legacy is best embodied in one transformative product: the index fund.

The logic is simple: If the EMH is (mostly) true and “beating the market” is nearly impossible over the long term, why pay high fees to active fund managers who try and (usually) fail? The work of Fama and his colleagues inspired figures like John Bogle to found Vanguard and create the first public index fund. The goal was no longer to *beat* the market, but to *be* the market-to buy a basket of all the stocks in an index (like the S&P 500) and simply hold on. This passive investing revolution has saved ordinary investors billions of dollars in fees and has become the default retirement strategy for a generation.

Today, the debate has softened. Most economists accept a middle ground: markets are not *perfectly* efficient, but they are *highly* competitive and *very* difficult to beat. The EMH isn’t a perfect description of reality, but it serves as the essential benchmark for performance. It’s the “null hypothesis” that every high-paid money manager must prove they can overcome. From the dusty archives of Parisian mathematics to the core of your 401(k), the Efficient Market Hypothesis remains a powerful and profoundly challenging idea.

What do you think? After reading its history, do you believe markets are truly efficient, or are they driven more by human psychology and “animal spirits”? And does the existence of wildly successful investors like Warren Buffett disprove the theory, or are they just the lucky monkeys with the darts?

References

1. https://www.investopedia.com/terms/p/perfectcompetition.asp
2. https://press.princeton.edu/books/hardcover/9780393053880/a-random-walk-down-wall-street
3. https://www.chicagobooth.edu/review/eugene-fama-and-the-efficient-market-hypothesis