Diversification – The Biggest Curse or the Only Hope?

Diversification – The Biggest Curse or the Only Hope?

#62 - Behind The Cloud: Fundamentals in Quant Investing (6/12)

Diversification – The Biggest Curse or the Only Hope?

November 2025

𝗙𝘂𝗻𝗱𝗮𝗺𝗲𝗻𝘁𝗮𝗹𝘀 𝗼𝗳 𝗤𝘂𝗮𝗻𝘁𝗶𝘁𝗮𝘁𝗶𝘃𝗲 𝗜𝗻𝘃𝗲𝘀𝘁𝗺𝗲𝗻𝘁𝘀

In this series, the Omphalos AI Research Team want to discuss the key and fundamental aspects of quantitative investing in detail and depth. In particular, our series will not be a beautiful story of how to build the holy grail of investing, but rather a long list of pitfalls that can be encountered when building such systems. It will not be a complete and exhaustive list of pitfalls, but we will try to describe those we discuss in great depth so that their significance is clear to everyone. And importantly, this will not be a purely theoretical discussion. We will provide a practical view on all of these aspects — shaped by real-world lessons and, in many cases, by our own painful and sometimes even traumatic experiences in building and testing systematic investment strategies. These hard-earned lessons are precisely why Omphalos Fund has been designed as a resilient, modular, and diversified platform — built to avoid the traps that have undone so many before.

At Omphalos Fund, we have always been clear about one thing: artificial intelligence is not magic. It is a powerful tool, but its value depends entirely on the system it operates in and the rules that guide it. When applied to asset management, this means that even the most advanced AI can only be effective if it is built on a deep understanding of how markets work — with all their complexities, inefficiencies, and risks.

That is why our latest Behind the Cloud white paper takes a step back from the technology itself. Instead, it examines the foundations of quantitative investing — the real-world mechanics, pitfalls, and paradoxes that shape investment strategies. The aim is not to present a flawless “holy grail” of investing, but to show the challenges and traps that every systematic investor must navigate.

We believe this is essential for anyone working with AI in finance. Without appreciating the underlying business of investing, AI models risk becoming black boxes that look impressive in theory but fail in practice. By shedding light on the subtle but critical issues in quantitative investment design — from overfitting to diversification, from the illusion of normal distributions to the reality of risk of ruin — we provide context for why our platform is built the way it is: modular, transparent, and resilient.

The goal of this white paper is simple:
To help readers understand that using AI in asset management is not only about smarter algorithms — it’s about building systems that are grounded in strong investment fundamentals and designed to survive the real world of markets.

Chapter 6

Diversification – The Biggest Curse or the Only Hope?

“Don’t put all your eggs in one basket.”

It’s one of the oldest rules in finance – and one of the most misunderstood. Diversification is often presented as the universal solution to risk, the “only free lunch” in investing. But for quants, it’s not that simple. Diversification can be either your greatest defense or your most dangerous illusion, depending on what truly lies beneath the correlations.

In systematic investing, diversification means spreading exposure across multiple strategies, assets, or timeframes. The logic is simple: if one system fails, another may succeed. But what if all systems fail at the same time? What if the supposed independence between them collapses exactly when it is needed most? And even more fundamentally: what if we’re simply diversifying across strategies that all have negative or zero expected value? Without positive expectancy in each component, diversification merely spreads losses more slowly – not avoids them.

That’s the paradox of diversification – and why understanding it deeply is essential for survival.

When Diversification Fails

In calm markets, diversification looks perfect. Correlations are low, volatility is stable, and risk models seem to confirm the benefits of spreading capital across multiple positions. Then comes a crisis. Suddenly, assets and strategies that once moved independently begin moving in the same direction – down.

Israelov (2020) showed empirically that diversification benefits often vanish under stress. When volatility spikes or liquidity evaporates, hidden dependencies emerge. What looked like a balanced portfolio becomes one concentrated bet on the same macro factor – often the same side of risk sentiment.

Markowitz’s original theory (1952) assumed that investors could combine uncorrelated assets to reduce risk. But real-world correlations are not constant. They are state-dependent – and in the states that matter most, they tend to converge toward one.

This phenomenon is not limited to traditional portfolios. It also plagues quantitative strategies. Two models may appear distinct – one trading trend, another mean reversion – yet both might suffer in the same volatile environment. Their signals may differ, but their vulnerabilities overlap.

The lesson is simple: diversification that disappears in crises isn’t diversification. It’s diversification – a comforting illusion that hides systemic fragility.

The Math Behind the Mirage

The statistical beauty of diversification lies in correlation. If two strategies are perfectly uncorrelated, their combined volatility should fall relative to their individual risks. But this relationship only holds when two conditions are met: correlations must remain stable and each strategy must have a positive expected value. If either assumption breaks, if correlations spike under stress or if one leg of the portfolio has no real edge, the entire diversification benefit collapses. In those moments, uncorrelated noise or negative‑expectancy systems don’t reduce risk; they simply dilute performance and delay the recognition of underlying fragility.

During normal periods, correlations might hover around 0.3 or 0.4. In crises, they can jump to 0.9 – meaning nearly all assets move together. The benefit of diversification evaporates precisely when it’s needed most.

This is why lack of correlation during negative periods – not during calm ones – is the real gold standard. True diversification is not about how assets behave when times are good, but how they behave when everything breaks.

Research Spotlight

    • Markowitz (1952): Introduced Modern Portfolio Theory, establishing diversification as the cornerstone of risk reduction.
    • López de Prado (2018): Advocated for diversification across truly independent strategy clusters, rather than superficial asset-class exposure.
    • Israelov (2020): Showed that correlations often rise dramatically during crises, erasing diversification benefits when they are most needed.
    • Taleb (2012): Emphasized that “real robustness” comes not from more diversification, but from anti-fragility – systems designed to benefit from volatility, not collapse under it.

 

Omphalos Perspective

At Omphalos Fund, diversification is not about quantity; it’s about independence. We build portfolios composed of autonomous trading agents, each designed to act, learn, and fail differently. The goal is not to have many strategies that look diverse – it’s to have strategies that truly behave differently, especially when markets turn chaotic.

Our approach focuses on:

    • Uncorrelated losses and positive expectancy: The two most important criteria for survival. We don’t just seek strategies that behave differently — we require that they remain uncorrelated during negative periods and each have a clearly positive expected value. Without both, diversification becomes an illusion that merely spreads losses.
    • Cross-regime robustness: Ensuring agents remain viable across market states – trending, volatile, or range-bound.
    • Orthogonality of logic: Distinct data sources, signals, and decision frameworks to minimize shared weaknesses.
    • Adaptive rebalancing: Allowing the ensemble to evolve dynamically, pruning correlated or underperforming agents to preserve independence.

Diversification is not static – it’s an ongoing process of observation, measurement, and adjustment. The system must constantly learn which combinations of agents preserve resilience under changing market conditions.

A Case in Point: When Diversification Disappeared

In 2008, global financial markets experienced what every risk model had deemed “impossible.” Strategies across equities, credit, commodities, and even hedge funds all collapsed together. Portfolios that had been carefully balanced for years suffered simultaneous drawdowns.

Funds that believed they were diversified across asset classes discovered that they were actually concentrated on a single variable: global liquidity.

The same phenomenon repeats in smaller form again and again – the Swiss franc shock in 2015, the COVID crash in 2020, or the bond-equity correlation reversal of 2022. Each time, investors learned that diversification is only real if it holds under pressure.

Closing Thought

Diversification remains both a curse and a hope. It’s a curse when misunderstood – when surface-level variety hides deep correlation. But it’s a hope when executed with clarity – when independence is verified, tested, and maintained through constant vigilance.
At Omphalos Fund, we don’t trust diversification by assumption. We measure it – especially when it hurts. True robustness isn’t about having more strategies; it’s about having the right mix that doesn’t fail together when the world does.

👉 In the next chapter, we’ll explore one of the most insidious and unavoidable pitfalls in all of systematic investing – future data leakage – where information from the future sneaks into your models, corrupting even the most carefully built systems.

Stay tuned for Behind The Cloud, where we’ll continue to explore the frontiers of AI in finance and investing.

Funds Europe nominated Omphalos Fund for the “Funds Europe Awards 2025” in the category “European Thought Leader of the Year”.

If you missed our former editions of “Behind The Cloud”, please check out our BLOG.

© The Omphalos AI Research Team November 2025

If you would like to use our content please contact press@omphalosfund.com 

WINNER !!!