Qwen1.5 4B Chat
Alibaba · 2024-02-04 · 4B parameters
Qwen1.5-4B-Chat is Alibaba's aligned chat checkpoint in the Qwen1.5 family, announced on February 4, 2024. It is a dense decoder-only Transformer with 3,950,369,280 parameters, a 32,768-token context window, and text-only input and output; Qwen states that the chat models were post-trained with supervised fine-tuning and direct preference optimization. Its chat template supports system, user, and assistant roles.