granitemoehybrid

Model type	granitemoehybrid
Class	GraniteMoeHybridCausalLMModel
Task	hybrid-text-generation
Source	models/granitemoehybrid.py

Description

GraniteMoeHybrid hybrid Mamba2+Attention causal language model with MoE FFN.

Usage

mobius build --model <MODEL_ID> output_dir/

from mobius import build

model = build("<MODEL_ID>")