InternSVG

<div align="center"> <h1> [ICLR 2026] InternSVG: Towards Unified SVG Tasks with Multimodal Large Language Models </h1> <div align="center"> <a href='https://arxiv.org/abs/2510.11341'><img src='https://img.shields.io/badge/arXiv-2510.11341-b31b1b?logo=arXiv'></a> &nbsp;&nbsp;&nbsp;&nbsp; <a href='https://hmwang2002.github.io/release/internsvg/'><img src='https://img.shields.io/badge/Project-Page-Green'></a> &nbsp;&nbsp;&nbsp;&nbsp; <a href="https://huggingface.co/datasets/InternSVG/SArena"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Benchmark%20-HF-orange"></a> &nbsp;&nbsp;&nbsp;&nbsp; <a href="https://huggingface.co/datasets/InternSVG/SAgoge"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Dataset%20-HF-orange"></a> &nbsp;&nbsp;&nbsp;&nbsp; <a href="https://huggingface.co/InternSVG/InternSVG-8B"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Model%20-HF-orange"></a> </div> <img src="/assets/overview.jpg" width="95%"/> </div>

📚 Introduction

We present the InternSVG family, an integrated data–benchmark–model suite.

• 🧩 SAgoge Dataset — The largest and most comprehensive multimodal dataset for SVG tasks, spanning icons, long-sequence illustrations, scientific diagrams, and dynamic animations. It provides rich hierarchical structures and diverse attributes, supporting tasks of varied difficulty levels.
• 📊 SArena Benchmark — A companion benchmark offering unified task definitions and standardized evaluation protocols, aligned with SAgoge’s domains and difficulty spectrum. It enables consistent comparison across SVG understanding, editing, and generation tasks.
• 🤖 InternSVG Model — A unified multimodal large language model (MLLM) for SVG understanding, editing, and generation.

🔥 News

• [2026-01-28] 🎉 InternSVG-8B is now available on HuggingFace! 🤗Model
• [2026-01-28] 🎉 We release the SAgoge dataset. 🤗Dataset
• [2026-01-26] 🎉 InternSVG has been accepted at ICLR 2026!
• [2025-10-13] 🎉 We release the SArena benchmark. 🤗Benchmark
• [2025-10-13] 👋 Upload paper and init project. Read

📝 Open-Source Plan

• [x] Evaluation code
• [x] SArena benchmark
• [x] SAgoge dataset
• [x] Fine-tuning scripts
• [x] Model weights
• [x] Paper

📌 Quick Start

⚙️ Installation

git clone https://github.com/hmwang2002/InternSVG.git
cd InternSVG

conda create -n internsvg python=3.9 -y
conda activate internsvg
pip install -r requirements.txt

# install clip
pip install git+https://github.com/openai/CLIP.git

Download ViCLIP.

mkdir sarena_ckpt
cd sarena_ckpt
# You need to login first and have the access to the repo https://huggingface.co/OpenGVLab/ViCLIP. Use the command "huggingface-cli login" to login.
huggingface-cli download --resume-download OpenGVLab/ViCLIP ViClip-InternVid-10M-FLT.pth --local-dir .
cd ..

For training, you need to install LLaMA-Factory.

pip install deepspeed==0.16.9
pip install av==14.4.0
cd LLaMA-Factory
pip install -e ".[torch,metrics]"
cd ..

(Optional) If you need to simplify your own SVG code, install svgo.

conda install nodejs
npm install -g svgo

🤖 InternSVG Model

The InternSVG-8B model is available at Hugging Face. It is based on the InternVL3-8B model, incorporating SVG-specific tokens, and undergoes Supervised Fine-Tuning (SFT) under a two-stage training strategy using the massive SVG training samples from the SAgoge dataset.

Deploy

We recommend using LMDeploy for deployment. An example of launching a proxy server with 8 parallel workers (one per GPU) is provided below:

#!/bin/bash
model_path="MODEL_PATH"
model_name="InternSVG"

# proxy
lmdeploy serve proxy --server-name 0.0.0.0 --server-port 10010 --routing-strategy "min_expected_latency" &

worker_num=8
for ((i = 0; i < worker_num; i++)); do
    timestamp=$(date +"%Y-%m-%d_%H-%M-%S")
    CUDA_VISIBLE_DEVICES="${i}" lmdeploy serve api_server ${model_path} --proxy-url http://0.0.0.0:10010 \
        --model-name ${model_name} \
        --tp 1 \
        --max-batch-size 512 \
        --backend pytorch \
        --server-port $((10000 + i)) \
        --session-len 16384 \
        --chat-template "internvl2_5" \
        --log-level WARNING &>> ./logs/api_${model_name}_${timestamp}_${i}.out  &
    sleep 10s
done

Train

If you need to train your own model, please follow these steps:

1. Prepare the Dataset: Download the SAgoge dataset. After that, update the paths for the SAgoge-related subdatasets in LLaMA-Factory/data/dataset_info.json to match your local file paths.

2. Download InternVL3-8B: Download the InternVL3-8B from link.

3. Add Special Tokens: Before training, you must add SVG-specific tokens to the base model. Run the utils/add_token.py script, which adds these special tokens to the original model weights and initializes their embeddings based on subwords.

4. Start Training: We provide example configuration scripts for the two-stage training process. You can find them at:

   • Stage 1: LLaMA-Factory/examples/train_full/stage_1.yaml
   • Stage 2: LLaMA-Factory/examples/train_full/stage_2.yaml

   Then use llamafactory-cli train to start training.

🧩 SAgoge Dataset

The SAgoge dataset is available at Hugging Face. To use SAgoge, please download the dataset and extract media.tar.gz to access the image files. After extraction, you will get:

SAgoge/
├── media/
│   ├── stage1/
│   │   ├── chem/
│   │   └── icon/
│   └── stage2/
│       ├── animation/
│       ├── chem/
│       ├── icon/
│       └── illustration/
├── stage1/
│   ├── chem/
│   │   ├── img2svg/
│   │   └── text2svg/
│   └── icon/
│       ├── edit/
│       ├── generation/
│       │   ├── img2svg/
│       │   └── text2svg/
│       └── understanding/
└── stage2/
    ├── animation/
    │   ├── text2sani/
    │   └── video2sani/
    ├── chem/
    │   ├── img2svg/
    │   └── text2svg/
    ├── icon/
    │   ├── edit/
    │   ├── generation/
    │   │   ├── img2svg/
    │   │   └── text2svg/
    │   └── understanding/
    └── illustration/
        ├── img2svg/
        └── text2svg/

Statistics of SAgoge:

| Dataset | #SVGs | #Samples | Avg. Tokens | | ------------ | --------- | ------------ | --------------- | | Icon | 2.8M | 11M | 846 | | Illustration | 600K | 1.6M | 8673 | | Animation | 61K | 122K | 847 | | Chemistry | 1.7M | 3.4M | 1752 |

📊 SArena Benchmark

Download

The SArena benchmark is available here. You can use the huggingface_hub command to download directly:

hf download InternSVG/SArena SArena.zip --repo-type dataset --resume-download --local-dir PATH_TO_YOUR_DIR
unzip SArena.zip

After extraction, you will get:

SArena/
├── animation/
│   ├── overall/
│   ├── svg/
│   ├── video/
│   ├── text2sani.jsonl
│   └── video2sani.jsonl
│
├── chemistry/
│   ├── images/
│   ├── svg/
│   ├── img2svg.jsonl
│   └── text2svg.jsonl
│
├── illustration/
│   ├── images/
│   ├── svg/
│   ├── caption.jsonl
│   ├── img2svg.jsonl
│   └── text2svg.jsonl
│
├── Icon/
│   ├── edit/
│   │   └── data/
│   │       ├── color_complex.jsonl
│   │       ├── color_simple.jsonl
│   │       ├── crop.jsonl
│   │       ├── flip.jsonl
│   │       ├── opacity.jsonl
│   │       ├── outline.jsonl
│   │       ├── rotate.jsonl
│   │       ├── scale.jsonl
│   │       ├── styletransform_openmoji.jsonl
│   │       └── translate.jsonl
│   │
│   ├── generation/
│   │   ├── images/
│   │   ├── svg/
│   │   ├── caption.jsonl
│   │   ├── img2svg.jsonl
│   │   └── text2svg.jsonl
│   │
│   └── understanding/
│       └── sarena_un.jsonl

Inference

Template scripts for inference can be found in the scripts/inference/ folder.

For example, for the icon/illustration/chemistry generation task, you can modify the script above by specifying your own paths and API configuration.

#!/bin/bash
export PYTHONPATH=$(pwd):$PYTHONPATH

BASE_URL="BASE_URL"
API_KEY="API_KEY"
MODEL_NAME="MODEL_NAME"
TEXT2SVG_TEST_PATH="PATH_TO_TEXT2SVG_TEST_PATH"
IMG2SVG_TEST_PATH="PATH_TO_IMG2SVG_TEST_PATH"
OUTPUT_DIR="PATH_TO_OUTPUT_DIR"
RETRY=1
TEMPERATURE=0.0
MAX_TOKENS=4000
MAX_WORKERS=32

python metrics/inference/inference.py \
--base_url ${BASE_URL} \
--api_key ${API_KEY} \
--model_name ${MODEL_NAME} \
--text2svg_test_path ${TEXT2SVG_TEST_PATH} \
--img2svg_test_path ${IMG2SVG_TEST_PATH} \
--output_dir ${OUTPUT_DIR} \
--temperature ${TEMPERATURE} \
--max_tokens ${MAX_TOKENS} \
--max_workers ${MAX_WORKERS}

Then run:

bash scripts/inference/gen/demo.sh

Specifically, for SVG animation generation task, a template inference script is provided at scripts/inference/animation/demo.sh.

When all test samples have been processed, each SVG file needs to be converted into an MP4 video for metric evaluation. Use the script utils/svg_animate.py to generate MP4 files. Note that we need two resolutions: 448×448 and 128×128. Before running, modify the OUTPUT_DIRS and FILE_DIRS variables in the run_all_mp() function. (Notably, in our code, if the output path contains '_128', it will automatically use the 128×128 resolution.)

The directory structure of the test files is as follows:

evaluate
├── .vscode
├── animation/gpt4o
│   ├── text2sani
│   │   ├── svg/
│   │   ├── video/
│   │   ├── video_128/
│   │   └── output.jsonl
│   └── video2s