# minimax_text_01

| | |
|---|---|
| **Model type** | `minimax_text_01` |
| **Class** | `MiniMaxCausalLMModel` |
| **Task** | `hybrid-text-generation` |
| **Source** | `models/minimax.py` |

## Description

MiniMax causal language model with hybrid Lightning + GQA + MoE.

Architecture:
- ``config.layer_types`` preserves the checkpoint's explicit per-layer schedule
- Full-attention layers use partial-RoPE GQA
- Lightning layers use a fixed-size recurrent state and no KV cache

Lightning Attention layers carry a single recurrent_state tensor of
shape (B, num_heads, head_dim, head_dim) per layer. Full attention layers
use the standard KV cache.

Task: ``hybrid-text-generation`` (HybridCausalLMTask).

HuggingFace model types: ``"MiniMaxText01"`` and ``"minimax"``

## Usage

```bash
mobius build --model <MODEL_ID> output_dir/
```

```python
from mobius import build

model = build("<MODEL_ID>")
```