Atlas

Benchmarks

← All benchmarks

Market-Bench - Dynamic Delta Hedging (Mean of 5)

Professional Work · 2025-12-13

The hard Market-Bench strategy asks a model to implement dynamic delta hedging using random-walk option deltas and MSFT order-book data, including persistent consumed liquidity, execution delay, stock and option exposure, profit and loss, equity, and drawdown. This definition reports mean absolute error averaged over five generated backtester runs.

Top models (lower is better)

ModelScore
GPT-5.21370
Grok 41482
Gemini 3 Pro Preview4596
GPT-5.1-Codex-Max10496
DeepSeek-V3.214724
Sonnet 4.516157
Opus 4.518945
Llama 4 Maverick21280
Nova Premier21346
Llama 3.1 Nemotron Ultra 253B V121346
Command A21370
Mistral Large 3 675B Instruct 251263683
Qwen3-Max (2025-09-23)329700
Loading Atlas data…