Quyen Pro V0.1
VILM · 2024-02-05 · 14.2B parameters
Quyen Pro V0.1 is a 14B model in VILM's Quyen v0.1 flagship series, fine-tuned from the Qwen1.5-14B base with supervised fine-tuning and DPO using open instruction and preference data. The Quyen series spans six Qwen1.5-based sizes from 0.5B to 72B and uses OpenHermes-2.5, Capybara, Intel orca_dpo_pairs, argilla/distilabel-capybara-dpo-7k-binarized, and private data prepared with Ontocord and BEE-spoke-data. The Pro variant is positioned below the 72B Quyen-Pro-Max model.
Benchmark scores
| Benchmark | Score |
|---|---|
| EQ-Bench v2 | 70.8 |
| EQ-Bench v2 + MAGI-Hard Combined | 59.0 |
| MAGI-Hard | 47.3 |