Hermes 3 Llama 3.1 70B
Nous Research · 2024-07-29 · 70.6B parameters
Hermes 3 Llama 3.1 70B is Nous Research's instruction-tuned fine-tune of Meta's Llama 3.1 70B, released in July 2024. It was fine-tuned on an approximately 390-million-token instruction dataset with primarily synthetically generated responses, retains the base model's 131,072-token context window, and adds agentic function calling and structured outputs. Because the dataset size is approximate and the base model's cumulative pretraining exposure is not exact, no exact training-token count is recorded.