llada_moe

Model type

llada_moe

Class

LLaDAMoEModel

Task

masked-diffusion

Source

models/llada.py

Description

LLaDA-MoE denoiser with raw selected softmax routing weights.

Usage

mobius build --model <MODEL_ID> output_dir/
from mobius import build

model = build("<MODEL_ID>")