InternVL2.5-1B

Original model repository: OpenGVLab/InternVL2_5-1B

Model Introduction

InternVL2.5-1B is an instruction-tuned Vision-Language Model (VLM) built on the InternVL2.5 architecture. It combines an InternViT-300M vision encoder, an MLP projector, and Qwen2.5-0.5B-Instruct as its language model. Compared with InternVL2, InternVL2.5 improves multimodal training and data quality for tasks such as OCR, document and chart understanding, visual question answering, visual grounding, and multi-image understanding.

Deployment Metrics

Model Parameters

Metric Value
Total model parameters 938.2M
Vision model (ViT) parameters 308.5M
Language model (LM) parameters 629.7M

Parameter counts are calculated from the tensors stored in the upstream checkpoint.

Performance Metrics

Test Configuration

Metric Value
Platform Matrix6P
Data type W8A8
ViT image size 448 × 448
Sequence length 512
Maximum context length 1024
BPU cores (ViT / Prefill / Decode) 4 / 4 / 4

Performance Results

Metric Value
ViT latency 29.323 ms
Time to first token (TTFT) 58.925 ms
Prefill throughput 25,026.701 tokens/s
Decode throughput 179.537 tokens/s

Memory Usage

Metric Value
BPU memory 1.01 GB
CPU memory 0.68 GB

Note: TTFT includes preprocessing and ViT latency. Memory values represent the peak memory usage measured during the specified performance test.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including OpenExplorer/InternVL2_5-1B