Failure To Design Relevant Stress Scenarios - Detailed Explanation

This is a Model Risk Failure under SR 11-7 / SR 26-2 (US Fed), PRA SS1/23 (UK), and Basel Committee Principles for Sound Stress Testing (2009, revised 2018).

A stress scenario is relevant only if it is:

1. Severe but plausible - not a historical replay
2. Idiosyncratic + Systemic - covers firm-specific concentration
3. Forward-looking - includes emerging risks not in data

Failure to design relevant scenarios means your stress test shows you are safe, while real market kills you. It is the #1 reason banks fail CCAR and EBA tests.

PRA Consultation Paper 1/15 and Moody's Analytics: "The most common pitfall is the design of meaningful scenarios that are severe but plausible at the same time. Depending on the scenario, the results may significantly misrepresent the risks to which a bank is actually exposed because the scenario may not be severe enough or plausible, or because it does not address important aspects."

Why Firms Fail To Design Relevant Scenarios

1. Optimistic Economic Assumptions: Using benign GDP, housing, unemployment paths
2. Historical Bias: Using last 5 years only, which were calm
3. Siloed Scenarios: Market risk designs one scenario, Credit designs another - correlation breakdown not captured
4. Ignoring Liquidity: Stressing price but not funding - Bear Stearns lesson

Case Laws & Regulatory Enforcement Actions

1. Dexia - The Classic Failure - Passed Stress Test, Failed 3 Months Later

Facts: Franco-Belgian bank Dexia passed the European Banking Authority (EBA) stress test in July 2011 with flying colors.

In October 2011, Dexia collapsed and needed €90 Billion bailout from Belgium, France, Luxembourg.

Why? EBA adverse scenario was a negative 3-year projection of GDP, unemployment, housing prices and interest rates, but did not appropriately reflect relevant systemic risks - specifically sovereign debt exposure to Greece, Italy. Stress test assumed sovereign debt was risk-free.

Regulatory Finding: European Court of Auditors Report, Luxembourg 10 July 2019: "EBA stress tests should focus more on EU-wide systemic risks... The adverse scenario used did not appropriately reflect all relevant systemic risks to the EU financial system."

Legal Principle: Passing a regulatory stress test is not a defense if your internal scenario design was irrelevant. Directors remain liable.

2. Deutsche Bank - Capital Shortfall During European Debt Crisis

Facts: During European debt crisis, Deutsche Bank stress testing revealed capital shortfalls.

Regulatory Finding: Stress tests underestimated potential losses from sovereign debt exposures and derivatives. Models failed to account fully for correlation between sovereign and bank credit. This is cited as case study of financial risk assessment failure due to weakness in assessing stress scenarios.

Resulted in Fed and BaFin MRIA - Matter Requiring Immediate Attention - and restriction on capital distributions.

3. JPMorgan Chase - London Whale - 2012 - Failure to Design Credit Correlation Stress

Facts: CIO synthetic credit portfolio $157B. Internal stress scenario designed by risk was based on 2011 benign credit environment. Scenario assumed IG and HY would move together with correlation 0.3-0.5. When stress hit, correlation broke to -1 (long/short legs both lost).

SR 11-7 violation: Model Development and Approval process allowed traders to use non-relevant stress scenario to justify huge positions. Fed OCC enforcement: Deficiencies in Model Development allowed traders to trade while underestimating risks.

Penalty: $920M fine - SEC, OCC, Fed, FCA. Admitted to ineffective internal controls under Sarbanes-Oxley.

This is direct enforcement for SR 11-7 - Stress testing and scenario analysis are vital components of model governance. Failure to design relevant scenario = model governance failure.

4. US CCAR Failures - Citigroup 2014, Capital One, etc.

Dodd-Frank Act Stress Test (DFAST) and Comprehensive Capital Analysis and Review (CCAR) require fortress balance sheets to withstand severely adverse: 65% decline in equity prices, 30-40% drops in real estate, 10% unemployment.

Case: Citigroup CCAR 2014: Fed rejected Citi's capital plan - not because capital was low, but because "qualitative deficiencies in capital planning practices, including inadequate stress scenarios that did not capture Citi's material exposures to trading, counterparty, and operational risk."

Consequence: Cannot increase dividend, cannot buy back shares, public reputational damage.

5. Reserve Primary Fund - SEC v. Reserve Management Company, Inc., Case No. 1:09 CV 4346 (S.D.N.Y. 2009)

The 2008 crisis as real-life stress test.

Collapse of Primary Reserve Fund in wake of Lehman bankruptcy. Money market fund had $785M Lehman exposure. Stress scenario designed by manager assumed commercial paper was riskless and redeemable at par.

SEC Enforcement: SEC charged intentional fraud - fund represented it had robust stress testing for credit events, but scenario did not include failure of a major dealer. $3.5B run, fund broke the buck.

Principle: If you represent to investors that you stress test, but your scenario excludes obvious relevant risk (single-name concentration), it is securities fraud.

6. Lehman Brothers & Bear Stearns - Liquidity Stress Scenario Failure

Senior Supervisors Group Report for BIS March 2008 and SEC testimony July 24, 2008 by Christopher Cox:

Immediately after Bear Stearns run, SEC noted: "Run-on-the-bank phenomenon demonstrated importance of incorporating loss of short-term secured funding into regulatory stress scenarios." Bear and Lehman had stress scenarios for market risk, but no scenario for loss of secured funding and haircut widening.

Dodd-Frank now mandates liquidity stress testing under LCR and NSFR.

7. EBA and ECB Enforcement - 2011-2019 Cycle

Case Study: The 2011 EU exercise is the only EU-wide stress test that resulted in significant negative market reaction. Why? It had higher capital threshold and disclosed more data than successful 2010 test, but governance challenges meant scenarios were not relevant.

EU Auditors: Adverse scenario did not reflect housing price collapse in Spain/Ireland, even though that was relevant.

Regulatory Framework That Makes This Illegal

1. US - SR 11-7 (2011) now SR 26-2 (April 2026):
"SR 11-7 isn't a statute with fines attached - it's supervisory guidance, enforced through examination process. Non-compliance shows up as examiner finding, Matter Requiring Attention (MRA), or formal enforcement action or restriction on bank's ability to expand use of model or launch new products until gaps are remediated."

Stress testing and scenario analysis are vital components.

2. Basel III - Principles for Sound Stress Testing (2009): Principle 3 - Stress testing should cover relevant risk factors and consider system-wide interactions.

3. India - RBI Financial Stability Report & Risk Based Supervision: Banks must design scenarios covering sovereign, credit concentration, and interest rate risk in banking book (IRRBB). Yes Bank 2020 reconstruction - RBI inspection found stress scenarios did not capture concentration to single group and AT1 bond trigger.

How Courts Assess "Relevance"

Courts use 3 tests from BCBS and Fed guidance:

1. Severe but Plausible Test: Would a reasonable risk manager in your position have included this scenario?
2. Reverse Stress Test: What scenario would cause you to fail? Did you design it? UK PRA now mandates reverse stress testing.
3. Idiosyncratic Test: Did scenario include your firm's specific concentration? Dexia failed this.

If answer is No, it is failure of duty of care and can lead to:

• MRA/MRIA and capital add-on (Pillar 2)
• CCAR objection - cannot distribute capital
• Personal liability under Sec 66 IBC (India) / Senior Managers Regime (UK) - failure to exercise commercial prudence
• Securities fraud if disclosed to investors

Best Practice to Design Relevant Scenarios Now

1. Scenario Expansion: Consistent scenario expansion - Use GVAR approach used by Oesterreichische Nationalbank to generate global macro consistent scenarios
2. Include at least: Sovereign default, 200bps rate shock, 40% housing drop, loss of secured funding for 30 days, counterparty default of largest exposure, correlation breakdown to 1
3. Document Why Scenario is Relevant: Link to your portfolio - e.g., if you have 30% real estate, your scenario must have housing price as risk factor.