Yi-9B
01.AI · 2024-03-06 · 8.8B parameters
Yi-9B is an open-weight bilingual English/Chinese base language model from 01.AI, publicly released on March 6, 2024. 01.AI created it by depth-upscaling Yi-6B from 32 to 48 layers through duplication of 16 middle layers, then continued pretraining on a corpus reported as 0.8 trillion tokens; the release highlights coding, mathematics, commonsense reasoning, and reading comprehension.