persimmon

Model type

persimmon

Class

PersimmonCausalLMModel

Task

text-generation

Source

models/persimmon.py

Description

Persimmon causal language model with FCMLP and QK LayerNorm.

Usage

mobius build --model <MODEL_ID> output_dir/
from mobius import build

model = build("<MODEL_ID>")