Atlas

Benchmarks

← All benchmarks

Market-Bench - Dynamic Delta Hedging (Best of 5)

Professional Work · 2025-12-13

The hard Market-Bench strategy asks a model to implement dynamic delta hedging using random-walk option deltas and MSFT order-book data, including persistent consumed liquidity, execution delay, stock and option exposure, profit and loss, equity, and drawdown. This definition reports the lowest mean absolute error among five generated backtester runs.

Top models (lower is better)

ModelScore
Sonnet 4.5805
Grok 41013
Gemini 3 Pro Preview1014
Qwen3-Max (2025-09-23)1088
DeepSeek-V3.21127
Mistral Large 3 675B Instruct 25121352
GPT-5.21365
GPT-5.1-Codex-Max1371
Opus 4.51371
Command A19853
Llama 4 Maverick20419
Nova Premier21346
Llama 3.1 Nemotron Ultra 253B V121346
Loading Atlas data…