qwen3_vl_text

Model type	qwen3_vl_text
Class	Qwen3VLTextModel
Task	text-generation
Source	models/qwen_vl.py

Description

Qwen3-VL text-only decoder.

Extends Qwen2.5-VL text decoder with Q/K normalization (RMSNorm on query and key projections), configured via attn_qk_norm=True.

Usage

mobius build --model <MODEL_ID> output_dir/

from mobius import build

model = build("<MODEL_ID>")