hunyuan_v1_dense¶


Model type	`hunyuan_v1_dense`
Class	`HunYuanV1DenseCausalLMModel`
Task	`text-generation`
Source	`models/hunyuan_v1.py`

Description¶

HunYuan V1 Dense text model.

HF HunYuanV1Dense unconditionally applies per-head RMSNorm on Q/K projections (query_layernorm / key_layernorm). We enable attn_qk_norm=True in the config and rename the HF weight keys.

Usage¶

mobius build --model <MODEL_ID> output_dir/

from mobius import build

model = build("<MODEL_ID>")