MiniCPM5-2B Released: A 2B-Class On-Device Model Powered by UltraData
MiniCPM5-2B is now available. The second model in the MiniCPM5 series is a dense 2B-class Transformer for on-device, local, and resource-constrained deployment, with a native 131K context window.
Model Highlights
According to the official model card, MiniCPM5-2B covers coding, mathematics, long-context understanding, tool use, and agent tasks, with leading results among 2B-class open-source models in its stated comparison.
Approximately 2.52B total parameters and 1.98B non-embedding parameters
42 Transformer layers with grouped-query attention
Native 131K context for local and resource-constrained use cases
UltraData Across the Training Lifecycle
MiniCPM5-2B applies UltraData L0-L4 tiered data management throughout pre-training, mid-training, and post-training. Publicly released data resources include:
Ultra-FineWeb
Ultra-FineWeb-L3
UltraX-Preview
UltraData-Code
UltraData-Math
UltraData-SFT-2605
UltraData-SFT-Agent-2609
UltraData-RL-2609
Resources
Hugging Face model card
ModelScope
GitHub