MiniCPM-SALA
MiniCPM Text Series
MiniCPM-SALA is a 9B-parameter model for ultra-long text. It uses a hybrid sparse and linear attention architecture and supports contexts of up to a million tokens.
Download the MiniCPM-SALA weights and prepare the corresponding runtime environment following the Deployment Guide. Resource requirements for long-context runs vary with your actual configuration, so check both your hardware and your inference parameters.
Key features
- Million-token context: Supports ultra-long context of up to 1M tokens
- Hybrid attention: 25% InfLLM-V2 sparse attention + 75% Lightning linear attention
- HyPE positional encoding: Handles ultra-long sequences efficiently
- 2.5x TTFT speedup: Compared with full-attention models, time to first token is reduced by 60%
Model downloads
| HuggingFace | ModelScope |
|---|---|
| MiniCPM-SALA | MiniCPM-SALA |
Developer Showcase
View all →ESP32 Radar Tower: AI ATC CalloutsA round-AMOLED tower radar announcing flights in a cloned ATC voiceSelf-Evolving Catgirl: Reasoning via On-Policy Self DistillationNo teacher, no new base model: math reasoning emerges from self-distillationReJev: Decision-Model Post-TrainingLoRA post-training MiniCPM5-2B: 51.1% → 80.5% on a sealed holdoutBMB Agent: a MiniCPM-powered Personal AssistantLetting a 2B on-device model take over schedules and todos, with real-world lessonsMetaCog: Judge-Steered ReasoningAn inference-time loop where a judge scores parallel thought pathsMiniCPM News Desk: Local Daily BriefA local-first daily brief where MiniCPM5-2B picks exact source passagesWebGPU Pi: In-Browser Coding AgentMiniCPM5-2B running a coding agent fully in-browser via WebGPUMiniCPM5-1B Tool-Use: Offline Function CallsA 1B GGUF function-calling model (SFT + GRPO) that runs offline on CPUdeku: A Trustworthy Local Task AgentCode plans, MiniCPM5-1B answers briefly or refusesMiniCPM5-1B: LiteRT & Iberian EvalsINT8 LiteRT-LM build plus Spanish, Catalan, Basque and Galician evalsMiniCPM Agent Gateway: Edge-Cloud RoutingLocal MiniCPM classifies each request so sensitive data stays on-deviceToneBridge: Context-Aware Mandarin CoachCorrects Mandarin sentences by context and tone, with pinyin and audioMiniCPM5-1B FP8: Faster NVIDIA InferenceFP8 vLLM profile hitting 248 decode tok/s on RTX 3060, 1.5× BF16AUGURY: Reading Soil Health from WeedsMaps weed species to soil-health indicators; phone-deployable, no cloudgmgn-minicpm: Local Crypto Research AgentA read-only GMGN crypto research agent powered by a local 1B modelLost & Found Desk: Small-Model Item ReturnMiniCPM-V captions items, MiniCPM5 guides claims, staff confirm every handoffCoreAI Model Zoo: MiniCPM on iPhoneCore AI builds of MiniCPM5 and MiniCPM-V 4.6 running natively on iPhone and MacViva Mais: Local WhatsApp CRM CopilotA travel-agency copilot that turns WhatsApp chats into a local-first CRMTianwen: BaZi & I-Ching ReflectionA 1B model that turns BaZi and I-Ching readings into self-reflectionWanderLust: Mood-Driven Discovery WalksPlans exploratory A-to-B walking routes based on your moodNIGHTWAVE: 1970s Radio Hosted by a 1B ModelA 1970s late-night radio with a 1B-model DJ who takes live calls6ixPulse: Agentic Toronto Rent MapAgents compare Toronto neighborhoods, citing a source for every claimWall Street of AI AgentsFour small-model AI traders roam a pixel office and trade on their ownHackathon Advisor: Idea Map & CoachMaps hackathon ideas and coaches you toward more original projectsLLM Cinema: AI-Directed ASCII FilmsA small model writes and directs ASCII-art films in the browsertiny-llm: A Pure-Rust Inference EngineA from-scratch, CPU-only Rust inference engine for MiniCPM5-1B with a TUIDocument Field Agent: Batch OCR & ExtractionA workbench for batch document OCR and structured field extractionWhen a Catgirl Learns to Think, on Your PhoneWas this model made for catgirls? An on-device deployment testMaking a 1B Model a Good Math AgentTeXada’s on-device MiniCPM practice and lessonsORG-2: A Workbench for Coding AgentsAn organizational workbench to orchestrate and manage multiple coding agentsEdgeHome HarnessA replayable, evaluable local control loop for a 1B on-device model, built in RustSqueezing a NAS: Hooking Up WorkBuddyRunning local AI on an N150 CPU: real-world uses and lessons learned