mixtral

Model type	mixtral
Class	MoECausalLMModel
Task	text-generation
Source	models/moe.py

Description

Generic Mixture of Experts causal language model.

Usage

mobius build --model <MODEL_ID> output_dir/

from mobius import build

model = build("<MODEL_ID>")