shieldgemma2

Model type

shieldgemma2

Class

Gemma2CausalLMModel

Task

text-generation

Source

models/gemma.py

Description

Gemma2 causal language model with alternating local/global attention.

Applies final logit soft-capping after LM head projection: logits = tanh(logits / softcap) * softcap

Replicates HuggingFace’s Gemma2ForCausalLM.

Usage

mobius build --model <MODEL_ID> output_dir/
from mobius import build

model = build("<MODEL_ID>")