Name: ChatGPT-4o Latest (source-unspecified snapshot)
Author: OpenAI

ChatGPT-4o Latest (source-unspecified snapshot)

OpenAI · 2024-08-15

ChatGPT-4o Latest (source-unspecified snapshot) is a benchmark-entry representation of OpenAI's mutable `chatgpt-4o-latest` alias, which pointed to the GPT-4o snapshot used in ChatGPT and changed over time. OpenAI has since removed the alias from the API, and the benchmark sources do not identify which underlying dated snapshot served each result.

Benchmark scores

Benchmark	Score
AidanBench	890
BuzzBench	59.5
HardGeoBench <=100mi	43.8
HardGeoBench <=10mi	31.3
HardGeoBench Avg Distance	1578
HardGeoBench Country Accuracy	52.5
LisanBench Difficulty-Weighted	94.2
LisanBench Path Length	303
Ruby LLM Benchmarks — Program Fixer	68.7
Ruby LLM Program Fixer — Calendar	78.0
Ruby LLM Program Fixer — Parking Garage	44.4
Ruby LLM Program Fixer — School Library	75.3
Ruby LLM Program Fixer — Vending Machine	77.1
Slop Score	47.7
Spiral-Bench v1.0 Safety Score	42.3
Spiral-Bench v1.2 Safety Score	25.2