talkie

Model type

talkie

Class

TalkieForCausalLM

Task

text-generation

Source

models/talkie.py

Description

Exact float Talkie causal LM with post-RoPE Q/K norm and embedding skips.

Usage

mobius build --model <MODEL_ID> output_dir/
from mobius import build

model = build("<MODEL_ID>")