Atlas

Benchmarks

← All benchmarks

FrontierSWE: FFmpeg libswscale Re-implementation (Mean@5)

Code · 2026-04-16

Reimplement FFmpeg's libswscale scaler and pixel-format converter in Zig or Rust. FrontierSWE Mean@5 is the average official task score across up to five independent long-horizon agent runs.

Top models (higher is better)

ModelScore
Claude Fable 57.5
Opus 4.80.4
GPT-5.50.3
Grok 4.50.3
GPT-5.40.3
GLM-5.20.2
Opus 4.60.1
Opus 4.70.1
GLM-5.10.1
DeepSeek-V4-Pro0.1
Gemini 3.1 Pro Preview0.1
Qwen3.6 Plus (2026-04-02)0.1
Kimi K2.60.1
Kimi K2.50.0
Composer 2.50.0
Loading Atlas data…