llama4_text

Model type

llama4_text

Class

Llama4CausalLMModel

Task

text-generation

Source

models/llama4.py

Description

Llama4 text model.

HF Llama4 uses feed_forward.* for MLP layers; our ONNX graph uses mlp.*. The preprocess_weights method renames them so weight transfer works correctly.

Usage

mobius build --model <MODEL_ID> output_dir/
from mobius import build

model = build("<MODEL_ID>")