phi3

Model type

phi3

Class

Phi3CausalLMModel

Task

text-generation

Source

models/phi3.py

Description

Phi-3 / Phi-3.5 model with SuRoPE and fused QKV weight splitting.

Usage

mobius build --model <MODEL_ID> output_dir/
from mobius import build

model = build("<MODEL_ID>")