markuplm¶
Model type |
|
Class |
|
Task |
|
Source |
|
Description¶
BERT encoder-only model for feature extraction.
Supports BERT, RoBERTa, and similar encoder architectures. Output is the last hidden state (no pooler head).
Module attributes match HF naming to eliminate most renames. Only prefix stripping and gamma/beta compat remain.
Replicates HuggingFace’s BertModel / RobertaModel.
Usage¶
mobius build --model <MODEL_ID> output_dir/
from mobius import build
model = build("<MODEL_ID>")