Empirical Validation

Backtest Engine

The ARGOS Financial Stress Score (FSS) and FX Stress Indicator are validated against 35 known financial and currency crises spanning 1995-2023 using genuine historical time series from the Bank for International Settlements (BIS) and the International Monetary Fund (IMF). The combined system achieves 88.6% recall at quarterly resolution with no parameter tuning.

Combined Recall

88.6%

31/35 crises

FSS Recall

77.1%

27/35 financial

FX Indicator

86.7%

13/17 currency

Remaining Misses

4

of 35 total

Data Coverage

60

BIS EER + 43 credit gap

Data Sources

BIS Credit-to-GDP Gap

43 countries, quarterly

1957-2023 (up to 263 quarters)

HP-filtered trend deviation, Basel III countercyclical buffer indicator

BIS Effective Exchange Rate

60 countries, monthly

1994-2023 (360 months)

Nominal broad index, 2020=100. FX Stress = 6-month depreciation rate.

IMF WEO Debt-to-GDP

226 countries, annual

1980-2025 (GGXWDG_NGDP)

General government gross debt as percentage of GDP

IMF WEO Fiscal Balance

229 countries, annual

1980-2025 (GGXCNL_NGDP)

Net lending/borrowing as percentage of GDP

Historical FSS Time Series

FSS computed at each historical year using the same formula applied to current data. Red threshold line at FSS=35 indicates crisis-level stress.

FSS=35200120062011201620210204060
Q

Quarterly-Resolution Backtest: 35 Crises (1995-2023)

Uses BIS quarterly credit gap directly + FX Stress Indicator for currency crises. Detection window: 4 quarters before crisis.

FSS Detected

27

FX Resolved

4

Remaining Misses

4

Combined Recall

88.6%

Quarterly Crisis Detection Results

FSS detected (credit/debt signal)FX resolved (currency depreciation signal)Genuine miss (data gap or no signal)

StatusCountryCrisisQuarterTypePeak FSSPeak AtLeadFX Stress
FSSUSALehman Brothers / GFC2008-Q3financial57.92008-Q12Q-
FSSUSASubprime mortgage crisis begins2007-Q4financial49.42007-Q31Q-
FSSGRCGreek debt crisis / first bailout2010-Q2financial95.82010-Q11Q-
FSSGRCGreek second bailout2011-Q3financial96.02011-Q21Q-
FSSGRCGreek third bailout / Grexit threat2015-Q3financial47.62014-Q44Q-
FSSIRLIreland banking crisis / bailout2010-Q4financial80.72010-Q31Q-
FSSPRTPortugal bailout2011-Q2financial77.82010-Q34Q-
FSSESPSpain banking crisis2012-Q2financial49.32011-Q34Q-
FSSITAItalian bond crisis2011-Q4financial61.52011-Q14Q-
FSSARGArgentine peso crisis2018-Q2currency46.52018-Q11Q-
FSSBRABrazil recession / fiscal crisis2015-Q3financial63.12015-Q12Q-
FSSRUSRussian default / ruble crisis1998-Q3financial73.81998-Q21Q-
FSSTHAThai baht crisis1997-Q3currency46.31997-Q21Q-
FSSIDNIndonesian banking collapse1998-Q1financial97.01997-Q41Q-
FSSMYSMalaysian ringgit crisis1998-Q1currency40.01997-Q41Q-
FSSGBRUK banking crisis (Northern Rock, RBS)2008-Q4financial40.62008-Q13Q-
FSSISLIceland banking collapse2008-Q4financial77.02008-Q31Q-
FSSCYPCyprus banking crisis / bail-in2013-Q1financial41.62012-Q41Q-
FSSHKGHong Kong protests + financial stress2019-Q3financial41.22019-Q21Q-
FSSLKASri Lanka sovereign default2022-Q2financial74.12022-Q11Q-
FSSPAKPakistan IMF emergency2023-Q1financial48.12022-Q41Q-
FSSLBNLebanon banking collapse2020-Q1financial93.32019-Q41Q-
FSSEGYEgypt pound devaluation2022-Q4currency51.32022-Q14Q-
FSSBOLBolivia FX reserve depletion2023-Q3financial54.22023-Q21Q-
FSSCHNChina stock market crash / devaluation2015-Q3financial48.02015-Q21Q-
FSSMEXTequila crisis1995-Q1currency89.01994-Q23Q-
FSSINDIndia taper tantrum / rupee crisis2013-Q3currency37.12013-Q13Q-
FXTURTurkish lira crisis2018-Q3currency25.22018-Q21Q34.7%
FXRUSRuble crisis (sanctions + oil)2014-Q4currency28.82014-Q31Q40.6%
FXKORKorean financial crisis1997-Q4currency26.81997-Q13Q42.5%
FXZAFSouth Africa downgrade to junk2020-Q1financial20.72019-Q14Q17.6%
MissARGArgentine default2001-Q4financial29.82001-Q22Q0.7%
MissNGANigeria naira float / devaluation2023-Q2currency13.32023-Q12Q-
MissBOLBolivia fiscal crisis (post-Morales)2020-Q1financial28.82019-Q41Q-
MissJPNJapan banking crisis (Yamaichi)1997-Q4financial25.11997-Q14Q2.0%
Methodology and Limitations

The backtest applies the identical FSS formula (Modification 3) and FX Stress Indicator (Modification 5) used in the current ARGOS engine to historical data. No parameters were tuned to fit past crises. The FSS formula weights are fixed: BIS credit gap (40%), IMF debt-to-GDP (35%), IMF fiscal balance (25%), with adaptive re-weighting when a component is unavailable.

Quarterly resolution advantage: Using BIS quarterly credit gap data directly (rather than annual averages) improves crisis timing detection. The GFC is detected at FSS=57.9 with 2-quarter lead time (Q1 2008, before the September Lehman collapse). The quarterly approach also captures the rapid credit gap build-up in Ireland (80.7) and Iceland (77.0) that annual data smooths away.

Remaining 4 misses: (1) Argentina 2001 - the peso peg masked FX stress until Q1 2002 when the peg broke; (2) Nigeria 2023 - no BIS EER data available; (3) Bolivia 2020 - no BIS data and IMF indicators were just below threshold (FSS=28.8); (4) Japan 1997 - a domestic banking crisis with no yen depreciation and low government debt at the time. These represent genuine epistemological limits of structural indicators.

BIS coverage gap: 43 of 87 ARGOS nations have BIS credit gap data; 60 have BIS EER data. For nations outside BIS coverage, the system relies solely on IMF indicators, reducing sensitivity but maintaining specificity.