feat: pack 2 fc layers in mlp with swiglu - #218

Open

Chamberlain0w0 wants to merge 4 commits into

feat/packed-swiglu

Commits on Sep 4, 2026

feat: pack 2 fc layers in mlp with swiglu
Chamberlain0w0
committed
2ff4941
fix: adjust up/gate layout order
Chamberlain0w0
committed
267659d

Commits on Sep 14, 2026

fix: fix layout description in comment and fix sharding logics in LoRA
Chamberlain0w0
committed
a6b2b4c

Commits on Sep 18, 2026

fix: resolve comments
Chamberlain0w0
committed
4d6a285