gemma

Model type

gemma

Class

GemmaCausalLMModel

Task

text-generation

Source

models/gemma.py

Description

Gemma causal language model with +1 RMSNorm offset and embedding scaling.

Usage

mobius build --model <MODEL_ID> output_dir/
from mobius import build

model = build("<MODEL_ID>")