Gemini 1.5 Flash Experimental 0827
Google DeepMind · 2024-08-27
Gemini 1.5 Flash Experimental 0827 was Google's August 27, 2024 experimental Gemini API snapshot of the latency-optimized, dense, multimodal Gemini 1.5 Flash family. The hosted artifact accepted text, images, audio, and video, returned text, exposed a 1,048,576-token input limit, and had no distinct extended-thinking mode.
Benchmark scores
| Benchmark | Score |
|---|---|
| BigCodeBench-Hard Complete | 23.6 |
| BigCodeBench-Hard Instruct | 19.6 |
| ZeroEval | 59.0 |
| ZeroEval CRUX | 74.5 |
| ZeroEval MATH Level 5 | 54.5 |
| ZeroEval MMLU-Redux | 82.1 |
| ZeroEval ZebraLogic | 25.0 |