olmo¶
Model type |
|
Class |
|
Task |
|
Source |
|
Description¶
OLMo model with weight-free LayerNorm (not RMSNorm).
OLMo-1B uses LayerNorm without learnable weight/bias and eps=1e-5, unlike Llama which uses RMSNorm with learnable weight.
Usage¶
mobius build --model <MODEL_ID> output_dir/
from mobius import build
model = build("<MODEL_ID>")