Tiny Aya Global
Cohere · 2026-02-17 · 3.3B parameters
Tiny Aya Global is Cohere Labs' globally balanced instruction-tuned Tiny Aya checkpoint, post-trained from a dense 3.35B-parameter base pretrained for 6 trillion tokens; Cohere describes the family as covering 70 languages, although this checkpoint's model-card metadata enumerates 67 language tags. It uses a 36-layer decoder-only Transformer with 3:1 interleaved 4,096-token sliding-window RoPE layers and global NoPE layers plus grouped-query attention. Cohere targets local and on-device multilingual generation; its documentation and technical report support 8,192-token input and output contexts, although the official GGUF conversion declares 500,000 maximum positions.