feature/qwen35 (5637da3, 5 commits) adds a Qwen3.5 hybrid runtime — Qwen35Runtime.kt (+637) interleaving Gated-DeltaNet (SSM) layers with full-attention layers — plus a Qwen byte-level BPE tokenizer, the Qwen3.5 chat template, and tool-call parsing. ~2,440 insertions across 20 files.
The work is genuinely valuable and shouldn't be lost. Commit 4af7e99 documents a real debugging arc, enumerating 9 specific DeltaNet bugs fixed by cross-referencing llama.cpp and the NVlabs GatedDeltaNet reference (3-way QKV split, channel-major conv1d indexing, delta-rule recurrence, softplus(alpha+dt_bias)*ssm_a decay, per-head L2 norm, Q/K head repetition 16→32, output path order, sigmoid gate). Qwen35RuntimeTest.kt (+365) covers these with 11 unit tests on a tiny synthetic model (dim=16, 4 layers, vocab=8) needing no GGUF — that test suite is the branch's real asset.
But it is not mergeable as-is. Newest commit is 2026-04-11 (~97 days old) and it sits 473 commits behind develop.
Checklist
Notes
- Conflict surface is small (4 conflicts, 8 overlapping files) — the risk is staleness and the engine gap, not merge mechanics.
- Purely additive API-wise: zero removed
public declarations.
- Explicitly out of scope for 0.36.1, which ships BGE embeddings + vec2text beam search only.
feature/qwen35(5637da3, 5 commits) adds a Qwen3.5 hybrid runtime —Qwen35Runtime.kt(+637) interleaving Gated-DeltaNet (SSM) layers with full-attention layers — plus a Qwen byte-level BPE tokenizer, the Qwen3.5 chat template, and tool-call parsing. ~2,440 insertions across 20 files.The work is genuinely valuable and shouldn't be lost. Commit
4af7e99documents a real debugging arc, enumerating 9 specific DeltaNet bugs fixed by cross-referencing llama.cpp and the NVlabs GatedDeltaNet reference (3-way QKV split, channel-major conv1d indexing, delta-rule recurrence,softplus(alpha+dt_bias)*ssm_adecay, per-head L2 norm, Q/K head repetition 16→32, output path order, sigmoid gate).Qwen35RuntimeTest.kt(+365) covers these with 11 unit tests on a tiny synthetic model (dim=16, 4 layers, vocab=8) needing no GGUF — that test suite is the branch's real asset.But it is not mergeable as-is. Newest commit is 2026-04-11 (~97 days old) and it sits 473 commits behind develop.
Checklist
545f06a(2026-04-21).printlns. Commit33efe46is explicitly titled "add init-time dimensional validation and diagnostic prints". Residue inQwen35Runtime.ktinit includesprintln("Qwen35Runtime: dim=$dim nHeads=$nHeads ..."),println(" ssmQkvDim=... headRatio=..."),println(" GGUF shapes: attn_qkv=$qkvShape ..."),println(" matmul convention: ..."). Some other printlns are legitimate CLI/demo output — check case by case.llm-inference/llama/.../LlamaWeightLoader.kt(±114); develop has renamed it toDecoderGgufWeightLoader.kt. This is a rename/edit conflict git will not resolve cleanly.tests/smoke/SMOKE-TEST.mdis deleted on develop — the branch modifies it (modify/delete conflict).tests/smoke/smoke-models.jsonandllm-runtime/kllama/.../cli/Main.ktalso conflict (content).transformer-coreinterplay — the branch predates thetransformer-coremodule entirely (added7c8e4c8, 2026-07-03).Notes
publicdeclarations.