gemma3_text

Model type

gemma3_text

Class

Gemma3CausalLMModel

Task

text-generation

Source

models/gemma3_text.py

Description

Gemma 3 text model with hybrid attention (global + sliding window), QK-norm, and four-norm decoder layers.

Usage

mobius build --model <MODEL_ID> output_dir/
from mobius import build

model = build("<MODEL_ID>")