bitnet

Model type

bitnet

Class

BitNetCausalLMModel

Task

text-generation

Source

models/bitnet.py

Description

BitNet decoder-only language model with exact attention/FFN sub-norm topology.

Usage

mobius build --model <MODEL_ID> output_dir/
from mobius import build

model = build("<MODEL_ID>")