doge

Model type

doge

Class

DogeCausalLMModel

Task

text-generation

Source

models/doge.py

Description

DOGE model with SSM dynamic attention mask and learnable residual gates.

Usage

mobius build --model <MODEL_ID> output_dir/
from mobius import build

model = build("<MODEL_ID>")