gemma2

Model type	gemma2
Class	Gemma2CausalLMModel
Task	text-generation
Source	models/gemma.py

Description

Gemma2 causal language model with alternating local/global attention.

Applies final logit soft-capping after LM head projection: logits = tanh(logits / softcap) * softcap

Replicates HuggingFace’s Gemma2ForCausalLM.

Usage

mobius build --model <MODEL_ID> output_dir/

from mobius import build

model = build("<MODEL_ID>")