Nous Hermes 2 Mixtral 8x7B SFT
Nous Research · 2023-12-26 · 46.7B parameters
Nous Hermes 2 Mixtral 8x7B SFT is Nous Research's supervised-fine-tune-only variant of the Mixtral 8x7B sparse mixture-of-experts model, trained on over one million entries of primarily GPT-4-generated data and other high-quality open datasets. It uses the ChatML prompt format and was released alongside a companion SFT+DPO variant.