MiniCPM-V 4
MiniCPM-V Multimodal Series
MiniCPM-V 4 is a 4.1B-parameter multimodal model built on a SigLIP2-400M + MiniCPM4-3B architecture.
Key Features
- OpenCompass average score of 69.0, surpassing GPT-4.1-mini and MiniCPM-V 2.6 (8.1B)
- Efficient on-device: first-token latency <2s and generation speed >17 tokens/s on iPhone 16 Pro Max
- Outperforms Qwen2.5-VL-3B, which has a comparable parameter count
Model Download
Quick Start
Python
import torch
from transformers import AutoModel, AutoTokenizer
from PIL import Image
model = AutoModel.from_pretrained(
"openbmb/MiniCPM-V-4",
trust_remote_code=True,
torch_dtype=torch.bfloat16
).eval().cuda()
tokenizer = AutoTokenizer.from_pretrained("openbmb/MiniCPM-V-4", trust_remote_code=True)
image = Image.open("image.jpg").convert("RGB")
msgs = [{"role": "user", "content": [image, "描述图片内容。"]}]
answer = model.chat(msgs=msgs, tokenizer=tokenizer)
print(answer)
Fine-tuning
Bash
cd MiniCPM-V
MODEL="openbmb/MiniCPM-V-4"
LLM_TYPE="qwen"
sh finetune/finetune_lora.sh
Related Resources
| Topic | Link |
|---|---|
| Fine-tuning | MiniCPM-V 4 fine-tuning guide |
| Code repository | OpenBMB/MiniCPM-V |
| Official model documentation | minicpm_v4_en.md |
| On-device apps and downloads | MiniCPM-V-Apps downloads |
Developer Showcase
View all →MiniCPM Agent Gateway: Edge-Cloud RoutingLocal MiniCPM classifies each request so sensitive data stays on-deviceLost & Found Desk: Small-Model Item ReturnMiniCPM-V captions items, MiniCPM5 guides claims, staff confirm every handoffCoreAI Model Zoo: MiniCPM on iPhoneCore AI builds of MiniCPM5 and MiniCPM-V 4.6 running natively on iPhone and MacViva Mais: Local WhatsApp CRM CopilotA travel-agency copilot that turns WhatsApp chats into a local-first CRMAranya: Seeing Plants, Telling Their StoriesLoRA-tuned MiniCPM-V 4.6 identifies plants and diagnoses their healthWhen a Catgirl Learns to Think, on Your PhoneWas this model made for catgirls? An on-device deployment testMaking a 1B Model a Good Math AgentTeXada’s on-device MiniCPM practice and lessonsReconciliation Workbench: OCR Tie-OutMiniCPM-V reads financial reports; a deterministic engine catches OCR digit errors