neo_bert_gguf

Model type

neo_bert_gguf

Class

NeoBertGGUFModel

Task

feature-extraction

Source

models/gguf_encoders.py

Description

NeoBERT’s packed-QKV and fused-SwiGLU pre-RMSNorm RoPE encoder.

Usage

mobius build --model <MODEL_ID> output_dir/
from mobius import build

model = build("<MODEL_ID>")