mixtral

Model type	mixtral
Class	MoECausalLMModel
Task	text-generation
Source	models/moe.py

Description

Generic Mixture of Experts causal language model.

Compatible with Mixtral, Qwen3-MoE, OLMoE, GraniteMoE, and other standard MoE architectures using top-k sparse routing.

Usage

mobius build --model <MODEL_ID> output_dir/

from mobius import build

model = build("<MODEL_ID>")