jamba

Model type	jamba
Class	JambaCausalLMModel
Task	hybrid-text-generation
Source	models/jamba.py

Description

Jamba hybrid SSM+Attention causal language model.

Uses HybridCausalLMTask with mixed "mamba" and "full_attention" layer types for the KV/SSM cache.

HuggingFace reference: JambaForCausalLM.

Usage

mobius build --model <MODEL_ID> output_dir/

from mobius import build

model = build("<MODEL_ID>")