EXAONE 3.0 7.8B Instruct
LG AI Research · 2024-08-07 · 7.8B parameters
EXAONE 3.0 7.8B Instruct is LG AI Research's publicly released bilingual English-Korean instruction-tuned language model, released on August 7, 2024. It is a decoder-only Transformer with a 4,096-token maximum context; LG reports two pretraining stages described as 6T and an additional 2T curated tokens, followed by supervised fine-tuning and offline and online direct preference optimization.
Benchmark scores
| Benchmark | Score |
|---|---|
| EQ-Bench v2 | 66.7 |
| EQ-Bench v2 + MAGI-Hard Combined | 54.8 |
| MAGI-Hard | 42.8 |