# neo_bert_gguf

| | |
|---|---|
| **Model type** | `neo_bert_gguf` |
| **Class** | `NeoBertGGUFModel` |
| **Task** | `feature-extraction` |
| **Source** | `models/gguf_encoders.py` |

## Description

NeoBERT's packed-QKV and fused-SwiGLU pre-RMSNorm RoPE encoder.

## Usage

```bash
mobius build --model <MODEL_ID> output_dir/
```

```python
from mobius import build

model = build("<MODEL_ID>")
```